Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revamp peer recovery flow for remote backed indexes #11331

Open
sachinpkale opened this issue Nov 26, 2023 · 1 comment
Open

Revamp peer recovery flow for remote backed indexes #11331

sachinpkale opened this issue Nov 26, 2023 · 1 comment
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework

Comments

@sachinpkale
Copy link
Member

  • Currently, peer recovery for remote backed indexes works in 2 modes.

  • Target node downloads latest segments from remote segment store and the incremental segments (that are created on source while target was downloading the segments) are copied node-to-node from source to target.

  • This bi-modal behavior may create confusion or even regression if we build a feature that assumes no data copy between the two nodes.

  • In this feature request, we want to restrict data source at one place for remote backed indexes: remote segment store

  • More details to be added

@sachinpkale sachinpkale added enhancement Enhancement or improvement to existing feature or request untriaged Storage:Durability Issues and PRs related to the durability framework and removed untriaged labels Nov 26, 2023
@ashking94
Copy link
Member

for remote store, it should not be called peer recovery any more, but may be something else like "Remote store recovery".

@ashking94 ashking94 moved this from 🆕 New to Next (Next Quarter) in Storage Project Board Apr 18, 2024
@ashking94 ashking94 moved this from Next (Next Quarter) to Ready To Be Picked in Storage Project Board Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework
Projects
Status: Ready To Be Picked
Development

No branches or pull requests

2 participants