Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gzip model log files after running #306

Open
rburghol opened this issue Dec 13, 2020 · 0 comments
Open

Gzip model log files after running #306

rburghol opened this issue Dec 13, 2020 · 0 comments

Comments

@rburghol
Copy link
Collaborator

rburghol commented Dec 13, 2020

To save space. Need to insure that all model routines in php and R are able to handle gz log files.

  • Update database by sql to chagne file name for scenarios that have been changed manually
    • Already gzipped runs 21, 22 and 23, 0, 1, need to update in database (see script below for batch gzipping)
  • Update model run code that stores log files to gz and amend file name upon run completion
  • Update om_get_runfile() in R and hydrotools support functions to use R.utils https://cran.r-project.org/web/packages/R.utils/R.utils.pdf
  • Update get rundata PHP server scripts to no longer zip large log files since they should already be gzipped

Code: batch gzip files

for i in `ls /home/rob/www/data/proj3/out/runlog23.*.log`; do gzip $i; done

# Some runs are so large and the ls * syntax breaks because of too many files, so we do:
for i in `ls /home/rob/www/data/proj3/out/runlog2.1*.log`; do gzip $i; done
for i in `ls /home/rob/www/data/proj3/out/runlog2.2*.log`; do gzip $i; done


Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant