feat: populate staging and dev with prod data #636
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jhonylucas74
changed the title
laura-l-amaral
approved these changes
Jul 18, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
Sync the data from production with the dev and staging environments to allow tests to be run on these projects in conditions closer to reality.
Description
In this PR, I have created two commands that can also be used in local development. One of them retrieves all the necessary data from Metabase in production. This will save all the relevant tables as JSON files in a folder to be used.
The second command cleans the database (except for things related to users and Stripe) and loads all the tables from Metabase into the database.
This PR also includes a cron task that, for testing purposes, will run every 2 hours but the final goal is to run it once a week. A custom model has also been added to the admin to control and monitor the tasks executed.
Checklist
Testing and evidence
Next steps
Test only in staging for now. If successful, deploy to dev.