PPUG_Introduction

Introduction to CESM Python Post Processing

The CESM python post processing repository code integrates light-weight parallel python tools developed by the NCAR CISL ASAP group and diagnostics plotting packages developed by the CESM Working Groups into a common framework that can be used to post process CESM data.

The post processing tools included in this repository follow a modular design where each tool performs a single function in the CESM post processing workflow. All CESM post processing tools assume the successful completion of the CESM case short term archive script and the subsequent adherence to the CESM paths and file naming conventions defined in CESM Model File Naming Conventions.

The CESM post processing tools include:

$PP_CASE_ROOT/timeseries

Convert model output history time slice data files to single variable time series files. Uses the env_timeseries.xml settings to define behavior. Use the queuing system submission command to submit. For example, on yellowstone using LSF, submit the timeseries script to the queue using command:

bsub < timeseries

$PP_CASE_ROOT/[comp]_averages

Compute the component averages and climatologies where comp is one of atm, ice, lnd, or ocn. Works with either history time slice or variable time series data. If using variable time series data, then the timeseries process must complete first. Uses the env_postprocess.xml and env_diags_[comp].xml settings to define behavior. To submit the script to compute the averages on yellowstone use commands:

|bsub < atm_averages |bsub < ice_averages |bsub < lnd_averages |bsub < ocn_averages

$PP_CASE_ROOT/lnd_regrid

Regrid the land climatology files (optional). This step may be necessary when the model land grid is something other than lat-lon which is required by the land diagnostics plotting routines. The regridding of the atmosphere averages is done in the atm_diagnostics script. Use yellowstone submission command:

bsub < lnd_regrid

$PP_CASE_ROOT/[comp]_diagnostics

Run the diagnostics plotting routines in parallel. Uses the env_postprocess.xml and env_diags_[comp].xml to define behavior. Depends on the successful completion of the [comp]_averages script. The yellowstone submission commands:

|bsub < atm_diagnostics |bsub < ice_diagnostics |bsub < lnd_diagnostics |bsub < ocn_diagnostics

$PP_CASE_ROOT/copy_html

Copies html and plot files to a user specified web server. Uses the env_postprocess.xml settings to define behavior. The script runs on the login node and does not require submission to the queue.