Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] Verify the chunk size of the snapshot when restoring a searchable snapshot #11739

Closed
bugmakerrrrrr opened this issue Jan 4, 2024 · 1 comment
Labels
enhancement Enhancement or improvement to existing feature or request Search:Searchable Snapshots

Comments

@bugmakerrrrrr
Copy link
Contributor

Is your feature request related to a problem? Please describe

During snapshotting in OpenSearch, large files are divided into fixed-size chunks. When restoring a snapshot as a searchable snapshot, the files are retrieved in fixed-size blocks as required. However, if the chunk size is not a multiple of the block size, it can cause issues where blocks span across two or more chunks, resulting in only the first part being fetched. This can lead to an EOF exception being thrown during searching.

Describe the solution you'd like

Verify that the chunk size of a snapshot used in the construction of RemoteSnapshotDirectory is a multiple of the block size. If it is not, an IllegalArgumentException will be thrown.

Related component

Other

Describe alternatives you've considered

No response

Additional context

No response

@bugmakerrrrrr
Copy link
Contributor Author

Closing in favour of #9676

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Search:Searchable Snapshots
Projects
None yet
3 participants