Support upload of repositories files to S3-compatible block storage services

[aecio]

ACHE generates a large amount of data and can fill-up disks quickly. Page repositories should be able to move data from local disk to scalable S3-compatible block storage services such as Amazon S3, OpenStack Swift, etc.

[anudeepti2004]

Will it make sense to have a thread running in the background to push the files to S3?

[anudeepti2004]

If no one is working on this, I would like to work on this..

[aecio]

Hey @anudeepti2004 !
Nobody is working on this yet. A thread makes sense. What I had in mind is: whenever the file rotation happens (the current file is closed, and a new file is created), we could start a thread to upload the latest closed file (or oldest n files, or something along these lines).

[aecio]

And to test it locally without S3, running an instance of minio (minio.io) is a good alternative.