Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Remote State] Parallel upload of metadata files to remote repo #9570

Closed
soosinha opened this issue Aug 28, 2023 · 0 comments · Fixed by #9664
Closed

[Remote State] Parallel upload of metadata files to remote repo #9570

soosinha opened this issue Aug 28, 2023 · 0 comments · Fixed by #9664
Labels
enhancement Enhancement or improvement to existing feature or request Indexing:Replication Issues and PRs related to core replication framework eg segrep Storage Issues and PRs relating to data and metadata storage untriaged

Comments

@soosinha
Copy link
Member

Is your feature request related to a problem? Please describe.
As part of uploading the remote state to blob repository, the individual index metadata files should be upload in parallel to reduce the overall latency of upload.
@soosinha soosinha added enhancement Enhancement or improvement to existing feature or request untriaged labels Aug 28, 2023
@soosinha soosinha mentioned this issue Aug 28, 2023
Open
23 tasks
@tlfeng tlfeng added Indexing:Replication Issues and PRs related to core replication framework eg segrep Storage Issues and PRs relating to data and metadata storage labels Sep 5, 2023
@linuxpi linuxpi mentioned this issue Sep 5, 2023
Merged
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Enhancement or improvement to existing feature or request Indexing:Replication Issues and PRs related to core replication framework eg segrep Storage Issues and PRs relating to data and metadata storage untriaged
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Remote Cluster State] Parallel and Multipart IndexMetadata uploads linuxpi/OpenSearch
2 participants
@tlfeng @soosinha