Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Remote Store] Durability issue with indices created via split/shrink/clone/manual snapshot recovery #10957

Closed
gbbafna opened this issue Oct 27, 2023 · 0 comments · Fixed by #10948
Assignees
Labels
bug Something isn't working untriaged

Comments

@gbbafna
Copy link
Collaborator

gbbafna commented Oct 27, 2023

Describe the bug

For remote store backed indices, if a user does split/shrink/clone/manual snapshot recovery, we don't guarantee that the segments created gets uploaded to remote, before taking in new writes.

In absence of this check, we won't be able to durable persist the index , by just using the Remote Translog for newer writes . This is because Remote Segment Store in combination of Remote Translog won't be able to construct the whole data via remote restore api.

Expected behavior

Before we enable writes on indices created via split/shrink/clone/manual snapshot recovery, the segments should be durably persisted.

This makes sure that at any point of time, the data is durably persisted.

@gbbafna gbbafna added bug Something isn't working untriaged labels Oct 27, 2023
@gbbafna gbbafna changed the title [BUG] [Remote Store] Issues with split/shrink/clone/manual snapshot recovery [Remote Store] Persistent issue with index created via split/shrink/clone/manual snapshot recovery Oct 27, 2023
@gbbafna gbbafna self-assigned this Oct 27, 2023
@gbbafna gbbafna changed the title [Remote Store] Persistent issue with index created via split/shrink/clone/manual snapshot recovery [Remote Store] Durability issue with indices created via split/shrink/clone/manual snapshot recovery Oct 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working untriaged
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant