Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update post-link scripts to fetch the raw input data files directly from the tudat-resources Github repository #1

Open
niketagrawal opened this issue Jul 26, 2022 · 0 comments

Comments

@niketagrawal
Copy link

niketagrawal commented Jul 26, 2022

Currently, creating a conda package for the input data files in tudat-resources GitHub repository presents a storage bottleneck on the Anaconda server. Considering that version control on individual data files is not needed, distributing the data files as releases on the GitHub repository could be a solution. As per the information here, Github allows individual file size in a release to be a maximum of 2GB, and does not impose any limits on the total size of the release.

Although bundling all the data files in the conda package presents storage issues, it is desired by the development team to continue using the conda package tudat-resources in the workflow as it simplifies the process of version compatibility management between tudat/tudatpy and tudatresources which would otherwise need to be addressed separately.

Removing the data files from the conda package tudat-resources can help address the storage concerns on the Anaconda server. This has been implemented in the branch feature/weightless.

As the next step, the existing post-link scripts need to be modified to support the download of the data files uploaded as releases. The post-link script should download the data files to the $HOME/.tudat/resource and maintain the same file tree structure as present to ensure that tudat and tudatpy feedstocks build successfully. The current file tree structure is the following:
$HOME/.tudat/resource/
| atmosphere_tables
| earth_orientation
| ...
| ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant