PPUG_create_postprocess

Setting up the CESM post processing case root using create_postprocess

The second setup step in running the CESM post processing tools is to create a post processing case root either as a stand-alone case or as part of an existing CESM experiment caseroot.

This step needs to be run for each unique CESM caseroot or CESM case DOUT_S_ROOT data archive.

cd [POSTPROCESS_PATH]

./create_postprocess --help

[(NPL) ] [aliceb@cheyenne1:~]>create_postprocess --help usage: create_postprocess [-h] [-backtrace] [-debug DEBUG] -caseroot CASEROOT [-cesmtag CESMTAG] [-project PROJECT] [-username USERNAME] [-add-dav ADD_DAV]

Read the necessary XML files from the postprocessing configuration system and translate them into bash scripts for batch submission of postprocessing tasks. Runtime options can be set in the XML files in the caseroot.

optional arguments: -h, --help show this help message and exit -backtrace, --backtrace show exception backtraces as extra debugging output -debug DEBUG, --debug DEBUG debugging verbosity level output: 0 = none, 1 = minimum, 2 = maximum. 0 is default -caseroot CASEROOT, --caseroot CASEROOT fully quailfied path to case root directory (required) -cesmtag CESMTAG, --cesmtag CESMTAG CESM repository tag (optional) -project PROJECT, --project PROJECT Project code (optional). This setting will override the environment variable setting. -username USERNAME, --username USERNAME User name (optional). Defaults to user login name. -add-dav ADD_DAV, --add-dav ADD_DAV Fully qualified path to the root of the CESM postprocessing virtualenv for the NCAR DAV cluster. This option sets the XML variable POSTPROCESS_PATH_DAV in env_postprocess.xml and creates all the necessary postprocessing batch scripts for the NCAR DAV Slurm manager. This option is only available when create_postprocess is run on NCAR machine cheyenne. A set of batch submission scripts in the postprocessing caseroot with the "_dav" extension are included along side the cheyenne PBS submission scripts. Example: /glade/p/cesm/postprocessing_dav. Defaults to "undefined". (optional)

The --caseroot option is mandatory and must contain a fully qualified path location to an existing CESM caseroot or a new post processing caseroot which will be created.

If an existing CESM caseroot exists, then all the post processing files are placed in a subdirectory called:

$CASEROOT/postprocess

If this is a stand-alone post processing caseroot, then all the post processing files are placed at the top of the specified CASEROOT option path. The post processing caseroot environment variable is called PP_CASE_PATH. For stand-alone post processing, the CASEROOT is that same as the PP_CASE_PATH.

create_postprocess reads and parses all the XML definition files in the POSTPROCESS_PATH and creates and copies all the case specific env_*.xml and batch submission script wrappers into the PP_CASE_PATH.