Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
G
gitlab-ce
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
1
Merge Requests
1
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
nexedi
gitlab-ce
Commits
07097b68
Commit
07097b68
authored
Jul 23, 2021
by
Kassio Borges
Committed by
Nick Gaskill
Jul 23, 2021
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
GithubImporter: Add missing docs about some recent added stages
parent
1cc201fd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
19 additions
and
3 deletions
+19
-3
doc/development/github_importer.md
doc/development/github_importer.md
+19
-3
No files found.
doc/development/github_importer.md
View file @
07097b68
...
@@ -69,7 +69,23 @@ don't need to perform this work in parallel.
...
@@ -69,7 +69,23 @@ don't need to perform this work in parallel.
This worker imports all pull requests. For every pull request a job for the
This worker imports all pull requests. For every pull request a job for the
`Gitlab::GithubImport::ImportPullRequestWorker`
worker is scheduled.
`Gitlab::GithubImport::ImportPullRequestWorker`
worker is scheduled.
### 5. Stage::ImportIssuesAndDiffNotesWorker
### 5. Stage::ImportPullRequestsMergedByWorker
This worker imports the pull requests' _merged-by_ user information. The
[
_List pull
requests_
](
https://docs.github.com/en/rest/reference/pulls#list-pull-requests
)
API doesn't provide this information. Therefore, this stage must fetch each merged pull request
individually to import this information. A
`Gitlab::GithubImport::ImportPullRequestMergedByWorker`
job is scheduled for each fetched pull
request.
### 6. Stage::ImportPullRequestsReviewsWorker
This worker imports the pull requests' reviews. For each pull request, this worker:
-
Fetches all the pages of reviews.
-
Schedules a
`Gitlab::GithubImport::ImportPullRequestReviewWorker`
job for each fetched review.
### 7. Stage::ImportIssuesAndDiffNotesWorker
This worker imports all issues and pull request comments. For every issue, we
This worker imports all issues and pull request comments. For every issue, we
schedule a job for the
`Gitlab::GithubImport::ImportIssueWorker`
worker. For
schedule a job for the
`Gitlab::GithubImport::ImportIssueWorker`
worker. For
...
@@ -85,7 +101,7 @@ label links in the same worker removes the need for performing a separate crawl
...
@@ -85,7 +101,7 @@ label links in the same worker removes the need for performing a separate crawl
through the API data, reducing the number of API calls necessary to import a
through the API data, reducing the number of API calls necessary to import a
project.
project.
###
6
. Stage::ImportNotesWorker
###
8
. Stage::ImportNotesWorker
This worker imports regular comments for both issues and pull requests. For
This worker imports regular comments for both issues and pull requests. For
every comment, we schedule a job for the
every comment, we schedule a job for the
...
@@ -96,7 +112,7 @@ returns comments for both issues and pull requests. This means we have to wait
...
@@ -96,7 +112,7 @@ returns comments for both issues and pull requests. This means we have to wait
for all issues and pull requests to be imported before we can import regular
for all issues and pull requests to be imported before we can import regular
comments.
comments.
###
7
. Stage::FinishImportWorker
###
9
. Stage::FinishImportWorker
This worker completes the import process by performing some housekeeping
This worker completes the import process by performing some housekeeping
(such as flushing any caches) and by marking the import as completed.
(such as flushing any caches) and by marking the import as completed.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment