Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Add support to separate segment infos snapshot from remote segment metadata #13129

Open
sachinpkale opened this issue Apr 9, 2024 · 0 comments · May be fixed by #13114
Open
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote

Comments

@sachinpkale
Copy link
Member

Is your feature request related to a problem? Please describe

Describe the solution you'd like

  • The inconsistency problem existed as we used to overwrite metadata and SegmentInfosSnapshot files for a given segment generation.
  • In [Remote Segment Store] Make metadata file immutable #8363, we made metadata file immutable.
  • Using the same concept of immutability, we can separate out SegmentInfosSnapshot and avoid the inconsistency problem.

Related component

Storage:Remote

Describe alternatives you've considered

No response

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Remote
Projects
Status: 🆕 New
Development

Successfully merging a pull request may close this issue.

1 participant