Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RED ALERT: DISCOURSE BACKUPS DON'T WORK (S3 Related) #12

Open
FarisZR opened this issue Oct 25, 2024 · 0 comments
Open

RED ALERT: DISCOURSE BACKUPS DON'T WORK (S3 Related) #12

FarisZR opened this issue Oct 25, 2024 · 0 comments

Comments

@FarisZR
Copy link
Member

FarisZR commented Oct 25, 2024

Discourse backups don't work.

When importing backups, files that are stored on R2 are inline linked as if S3 isn't enabled for some reason, rebaking the posts doesn't change anything.
Affected files are most optimized profile pics, site logos and new files uploaded since enabling S3.

Notable: migrate_to_s3 task also doesn't run correctly.

Even if I wanted to include S3 uploads into the backups, there is something missing in the R2-S3 compatible API stopping discourse from downloading the images in the backup process.

I can currently only move the server using by just copying the bind volumes, which isn't great and isn't how discourse backups work.

The plan

write a post about the S3 content link issue on meta

Maybe there's something that can fix this, because the files actually exist on R2, but the new discourse instance isn't using the R2 CDN-link for some reason.

Move off S3

the only officially supported S3 storage solution is AWS, to avoid further issues, we either move to AWS S3, which is very unpredictable in terms of monthly costs, or we disable S3 in discourse completely.

Because Discourse can't currently download uploads from R2 to include in the backups, we first need to move to a fully S3 compliant solution.
Cloning the bucket to a local minio instance, and then letting discourse use that as the new S3 host seems to be the best workaround.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant