Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write index and data file merge program #6

Open
tdunning opened this issue Aug 27, 2021 · 0 comments
Open

Write index and data file merge program #6

tdunning opened this issue Aug 27, 2021 · 0 comments

Comments

@tdunning
Copy link
Member

It may be desirable to merge many days of data files or grid point index files together to improve query speed.

This should be done by computing intermediate merge files for a week or month at a time. Merging index files should be relatively quick because of their simple structure.

Merging data files should also be fairly quick because all data elements should already be sorted. Having a fixed mapping from grid point to data file might be desirable to facilitate that merging.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant