Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Control opensearch insertion batch #160

Open
crystaldust opened this issue Mar 15, 2023 · 2 comments
Open

Control opensearch insertion batch #160

crystaldust opened this issue Mar 15, 2023 · 2 comments
Assignees
@crystaldust

Comments

@crystaldust
Copy link
Collaborator

Some data, like github commits, pr, issues are fetched and inserted by pages. Data in one page may not be as large as a batch. Setup a batch and collect these data into batch, when batch full, insert the batch data into opensearch
@crystaldust crystaldust self-assigned this Mar 15, 2023
@crystaldust
Copy link
Collaborator Author

#161

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@crystaldust crystaldust

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@crystaldust and others