-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Large files filling fcrepo memory with Amazon S3 Warning #534
Labels
bug
Something isn't working
Comments
This was referenced Apr 16, 2024
Update on staging for this... This item was uploaded via browse everything "Add cloud Files" which I believe uses the same import_url method as Bulkrax https://bl.bl-staging.notch8.cloud/concern/articles/99ea5d13-f282-4260-8659-231e0e64e7df?locale=en Is retrievable but currently with a somewhat awkward filename... |
Update for @NoraRamsey... filenames and should now be behaving on staging. please confirm |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Story
PUT request to fcrepo (with sS3) for larger files are failing due to memory use. These request are missing filesize according to this warning:
WARN 09:58:05.429 (AmazonS3Client) No content length specified for stream data. Stream contents will be buffered in memory and could result in out of memory errors.
and it is coming true when files are > 1 or 2 GB
org.glassfish.jersey.server.ContainerException: java.lang.OutOfMemoryError
I think that this would be solved with a fedora build that used a version of modeshape that includes this change: https://github.com/ModeShape/modeshape/pull/1654/files
Acceptance Criteria
Screenshots / Video / Stacktrace
Testing Instructions and Sample Files
Notes
The text was updated successfully, but these errors were encountered: