Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How should we manage files with multiple data sources in them #116

Open
jrdh opened this issue Aug 14, 2023 · 0 comments
Open

How should we manage files with multiple data sources in them #116

jrdh opened this issue Aug 14, 2023 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@jrdh
Copy link
Member

jrdh commented Aug 14, 2023

There's a few parts to this which are interrelated but the original source was (massively paraphrased):

"I've uploaded a zip with multiple files in it and it's picked a csv in there and indexed it. Now it shows 100 records next to a zip with like 20 files in it and it's weird."

Similar scenarios to this are:

  • "I've uploaded a spreadsheet with multiple sheets and it's indexed the first one and nothing else"
  • "I would like to download all the files in a dataset in one zip"

And probably others!

What's the best solution here? Some initial thoughts:

  • allow users to untick a "index this" checkbox when uploading a new resource
  • don't try to find an indexable file from uploaded zips (same applies to spreadsheets I guess, instead of indexing the first sheet, just don't)
  • an extension of the first option would be to allow users to select which file (if any) gets indexed from a zip/spreadsheet
  • unzip the zip and make a resource out of each of the files automatically (then allow downloading them all via a "download this dataset" feature)

moooooore probably.

@jrdh jrdh added enhancement New feature or request help wanted Extra attention is needed labels Aug 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
Development

No branches or pull requests

1 participant