Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

directory structures: com, umbrella, $DATA #498

Open
guoqing-noaa opened this issue Sep 24, 2024 · 1 comment
Open

directory structures: com, umbrella, $DATA #498

guoqing-noaa opened this issue Sep 24, 2024 · 1 comment

Comments

@guoqing-noaa
Copy link
Contributor

Based on today's discussion, we will have three different types of major directories depending on the lifetime of output files in the production:

  1. $DATA: this is the run directory of a task. Files under this directory will be removed upon the completion of a task

  2. umbrella: this directory holds output files to be shared inside one cycle and will be purged upon the completion of a cycle

  3. com: this directory holds output files to be shared across cycles and will be purged after ~6 days in production.

NOTE: both $DATA and umbrella are under $DATAROOT

In the workflow, we can set the default behavior to use the operational settings while in the develop platforms, users can have the flexibility to set the actual locations of the above three types of directories.

@MatthewPyle-NOAA @BenjaminBlake-NOAA @ShunLiu-NOAA @hu5970 @lgannoaa Let me know if there is anything I missed and feel free to edit/comment. Thanks!

@lgannoaa
Copy link
Contributor

The document for today's demo can be found here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants