Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for periodic snapshots of the full dataset in tabular format #57

Open
psadil opened this issue Mar 14, 2024 · 0 comments
Open

Comments

@psadil
Copy link

psadil commented Mar 14, 2024

What would you like to see added in this software?

This is such a valuable resource, and I'm very grateful that it's still running (and so only getting better!). However, I think the REST interface can make it difficult to download the dataset. This is partly because of the limit on the number of records that can be downloaded in one request (meaning that someone wanting the full dataset needs to coordinate many requests). I was recently able to grab all of the bold data (over 1 million records!) and was struck that the resulting table was under 200 MB (that's an M!). A file that small seems like it could be relatively straightforward to distribute. So, this is a request for monthly (quarterly, semiannually) snapshots that are made available as a table.

Do you have any interest in helping implement the feature?

Yes

Additional information / screenshots

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant