-
Notifications
You must be signed in to change notification settings - Fork 22
Creating ensemble submission
NutchaW edited this page Dec 23, 2019
·
10 revisions
Steps for creating and submitting a real-time ensemble forecast. This set of steps needs to be performed every Monday evening after 5pm (or whenever the last models get pushed) and before 11:59pm.
- Check compatibility and merge all relevant pull requests on the
master
branch. - Make sure you are on the
master
branch of thecdc-flusight-ensemble
repository. - Pull all recent commits.
- Check to see if all component models have current forecasts. If not, the ensemble will still build, but send email to nudge contributors.
- Run the
make-real-time-ensemble-forecast-file.R
script with the following command from root cdc-flusight-ensemble directory:Rscript ./scripts/make-real-time-ensemble-forecast-file.R <CURRENT WEEK>
where<CURRENT WEEK>
is the current EPIWeek as an integer (i.e. 42). This should generate a set of all ensemble forecast files, including one that is saved inmodel-forecasts/submissions/target-type-based-weights
, and a multi-page PDF file with plots in themodel-forecasts/submissions/target-type-based-weights/plots/
folder. - Look at the plots to make sure nothing looks terribly out of alignment.
- Commit the plots file and all new ensemble files to your local git repository. Your commit message MUST include: "trigger build" in lowercase letters (Travis is case-sensitive). i.e. "trigger build week 42".
- Push all files to the master branch.
- Submit the submission file to the CDC: Go to https://predict.cdc.gov and log in. Click Go to project on the current FluSight Challenge on the dashboard and click to Submit on the left panel. Upload this week's .csv file in the
model-forecasts/submissions/target-type-based-weights
folder. - Tweet out new forecasts!