Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EPIC [M] 4b Handle uploads and downloads of files in a timely reliable way with alternative ingest routes provided where the default isn't possible, e.g. AWS S3 CLI or similar alternative for cloud storage #85

Open
4 tasks
orangewolf opened this issue Oct 17, 2022 · 2 comments
Labels
Milestone

Comments

@orangewolf
Copy link
Contributor

orangewolf commented Oct 17, 2022

Summary

The consideration of storage options referred to above, will take into account performance (upload and download) and also suitability in providing alternative routes for ingest (e.g. for large files). It is worth noting that the Bulkrax gem, in conjunction with the Browse everything gem can provide for ingest of files from a range of locations. This would allow for options regarding alternative ingest routes. Bulkrax will be installed and configured (see 4c) as part of the migration work and browse everything is included by default in Hyku3.0

S3 bucket and Onedrive (Microsoft) to import for BrowseEverything. This might be at a tenant level.

Accepted Criteria

Screenshots or Summary

Testing Instructions

Notes

@crisr15 crisr15 added this to the AHRC 2 milestone Nov 15, 2022
@crisr15 crisr15 changed the title [M] 4b Handle uploads and downloads of files in a timely reliable way with alternative ingest routes provided where the default isn't possible, e.g. AWS S3 CLI or similar alternative for cloud storage EPIC [M] 4b Handle uploads and downloads of files in a timely reliable way with alternative ingest routes provided where the default isn't possible, e.g. AWS S3 CLI or similar alternative for cloud storage Nov 15, 2022
@jeremyf
Copy link
Contributor

jeremyf commented Dec 1, 2022

There is existing work in https://github.com/scientist-softserv/nnp/ that can be used as inspiration.

@cziaarm cziaarm added the SL-RC Service Label: Request for change label Jan 10, 2023
@cziaarm
Copy link
Collaborator

cziaarm commented Apr 17, 2024

#534 may be the final piece of this jigsaw

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Ready for Development (Bugs)
Development

No branches or pull requests

5 participants