Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
G
gitlab-ce
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
1
Merge Requests
1
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
nexedi
gitlab-ce
Commits
3dcea4fa
Commit
3dcea4fa
authored
Dec 05, 2018
by
Cody West
Committed by
Evan Read
Dec 05, 2018
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Docs - Add 11.5 ES reindex info
parent
edee6773
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
23 additions
and
18 deletions
+23
-18
doc/integration/elasticsearch.md
doc/integration/elasticsearch.md
+23
-18
No files found.
doc/integration/elasticsearch.md
View file @
3dcea4fa
...
...
@@ -58,7 +58,7 @@ installed before running `make`.
To install on Debian or Ubutu, run:
```
```
sh
sudo
apt
install
libicu-dev
```
...
...
@@ -66,7 +66,7 @@ sudo apt install libicu-dev
To install on macOS, run:
```
```
sh
brew
install
icu4c
export
PKG_CONFIG_PATH
=
"/usr/local/opt/icu4c/lib/pkgconfig:
$PKG_CONFIG_PATH
"
```
...
...
@@ -75,7 +75,7 @@ export PKG_CONFIG_PATH="/usr/local/opt/icu4c/lib/pkgconfig:$PKG_CONFIG_PATH"
To build and install the indexer, run:
```
```
sh
make
sudo
make
install
```
...
...
@@ -87,7 +87,7 @@ Please remember to pass the `-E` flag to `sudo` if you do so.
Example:
```
```
sh
PREFIX
=
/usr
sudo
-E
make
install
```
...
...
@@ -138,7 +138,7 @@ To disable the Elasticsearch integration:
Configure Elasticsearch's host and port in
**Admin > Settings**
. Then create empty indexes using one of the following commands:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:create_empty_index
...
...
@@ -148,7 +148,7 @@ bundle exec rake gitlab:elastic:create_empty_index RAILS_ENV=production
Then enable Elasticsearch indexing and run repository indexing tasks:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index
...
...
@@ -162,7 +162,7 @@ Enable Elasticsearch search.
Configure Elasticsearch's host and port in
**Admin > Settings**
. Then create empty indexes using one of the following commands:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:create_empty_index
...
...
@@ -184,7 +184,7 @@ curl --request PUT localhost:9200/gitlab-production/_settings --data '{
Then enable Elasticsearch indexing and run repository indexing tasks:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories_async
...
...
@@ -196,8 +196,7 @@ This enqueues a number of Sidekiq jobs to index your existing repositories.
You can view the jobs in the admin panel (they are placed in the
`elastic_batch_project_indexer`
)
queue), or you can query indexing status using a rake task:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories_status
...
...
@@ -215,7 +214,7 @@ You can also run the initial indexing synchronously - this is most useful if
you have a small number of projects, or need finer-grained control over indexing
than Sidekiq permits:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories
...
...
@@ -228,7 +227,7 @@ It might take a while depending on how big your Git repositories are.
If you want to run several tasks in parallel (probably in separate terminal
windows) you can provide the
`ID_FROM`
and
`ID_TO`
parameters:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories
ID_FROM
=
1001
ID_TO
=
2000
...
...
@@ -239,7 +238,7 @@ bundle exec rake gitlab:elastic:index_repositories ID_FROM=1001 ID_TO=2000 RAILS
Where
`ID_FROM`
and
`ID_TO`
are project IDs. Both parameters are optional.
As an example, if you have 3,000 repositories and you want to run three separate indexing tasks, you might run:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories
ID_TO
=
1000
sudo
gitlab-rake gitlab:elastic:index_repositories
ID_FROM
=
1001
ID_TO
=
2000
...
...
@@ -261,7 +260,7 @@ database, you can run the indexer with the special parameter `UPDATE_INDEX` and
it will check every project repository again to make sure that every commit in
that repository is indexed, it can be useful in case if your index is outdated:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_repositories
UPDATE_INDEX
=
true
ID_TO
=
1000
...
...
@@ -275,7 +274,7 @@ start.
To index all wikis:
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_wikis
...
...
@@ -288,7 +287,7 @@ to limit a project set.
Index all database entities (Keep in mind it can take a while so consider using
`screen`
or
`tmux`
):
```
```
sh
# Omnibus installations
sudo
gitlab-rake gitlab:elastic:index_database
...
...
@@ -318,6 +317,12 @@ Enable Elasticsearch search in **Admin > Settings**. That's it. Enjoy it!
Here are some common pitfalls and how to overcome them:
-
**I updated GitLab and now I can't find anything**
We continuously make updates to our indexing strategies and aim to support
newer versions of Elasticsearch. When indexing changes are made, it may
be necessary for you to [reindex](#adding-gitlabs-data-to-the-elasticsearch-index) after updating GitLab.
-
**I indexed all the repositories but I can't find anything**
Make sure you indexed all the database data [as stated above](#adding-gitlab-data-to-the-elasticsearch-index).
...
...
@@ -331,7 +336,7 @@ Here are some common pitfalls and how to overcome them:
If you enabled Elasticsearch before GitLab 8.12 and have not rebuilt indexes you will get
exception in lots of different cases:
```
```
text
Elasticsearch::Transport::Transport::Errors::BadRequest([400] {
"error": {
"root_cause": [{
...
...
@@ -355,7 +360,7 @@ Here are some common pitfalls and how to overcome them:
-
Exception
`Elasticsearch::Transport::Transport::Errors::RequestEntityTooLarge`
```
```
text
[413] {"Message":"Request size exceeded 10485760 bytes"}
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment