Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

formalize and implement bulk loading #6

Open
ksonda opened this issue Aug 4, 2022 · 0 comments
Open

formalize and implement bulk loading #6

ksonda opened this issue Aug 4, 2022 · 0 comments
Assignees

Comments

@ksonda
Copy link
Member

ksonda commented Aug 4, 2022

GraphDB seems to be able to ingest both jsonld graphs and what I would call jsonld "feature collections" that repeat the context over and over without much problem (see /create-bulk-files for examples).

This requires rules and implementation both for Gleaner @fils and for pids.geoconnex.us @webb-ben

Question is how to formalize submissions of these type over at https://github.com/internetofwater/geoconnex.us as part of the PID registration process.

Suggestion:

  • Come up with threshold count to ask for a regex
  • make regex require a "bulk link" column for a single .jsonld file with no pagination

Considerations:

  • Even bulk graphs may have some practical size limitations. This is why my workflow in /create-bulk-files splits large collections up into multiple .jsonld files
@ksonda ksonda changed the title formalize bulk loading formalize and implement bulk loading Aug 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants