Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use pre-computed offset tables for indexing #519

Closed
Tracked by #490
gkamat opened this issue Apr 25, 2024 · 1 comment
Closed
Tracked by #490

Use pre-computed offset tables for indexing #519

gkamat opened this issue Apr 25, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@gkamat
Copy link
Collaborator

gkamat commented Apr 25, 2024

Description

With large data corpora, it takes a long time for OSB to generate the offset file for a corpus. This process can be sped up considerably by uploading pre-computed offset tables. Implementing this capability will alleviate the issue of the user needing to wait for long periods of time (sometimes hours) before a test run can commence.

@gkamat
Copy link
Collaborator Author

gkamat commented Jun 7, 2024

Fixed with #542

@gkamat gkamat closed this as completed Jun 7, 2024
@github-project-automation github-project-automation bot moved this from In-Review to Done in Performance Roadmap Jun 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Done
Development

No branches or pull requests

1 participant