Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add how to add a recipe documentation #3614

Merged

Conversation

mo-gill
Copy link
Contributor

@mo-gill mo-gill commented May 23, 2024

Description

Add instructions on how to add a recipe to the recipe test workflow, to the documentation


Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

@mo-gill mo-gill self-assigned this May 23, 2024
@mo-gill mo-gill added the Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow label May 23, 2024
@mo-gill
Copy link
Contributor Author

mo-gill commented May 23, 2024

Hello @alistairsellar and @ehogan!

I have committed my first draft of this here 1f52310

I have some questions it would be helpful if you could address

  1. Should we add instructions for what to do when the recipe throws an error that it needs the user to download missing data?

  2. Do we need to run esmvaltool run locally first if we're getting the time/mem results from cylc review?

  3. I haven't run ESMValTool on JASMIN myself so unsure how much detail to go into for this in the documentation?

  4. Is kgo_rootpath site specific? (does it change between sites or is it always the same directory /data/users/esmval/KGO)?

Thanks

@mo-gill mo-gill changed the title Create how to add recipe docs Add how to add a recipe documentation May 23, 2024
@ehogan
Copy link
Contributor

ehogan commented May 23, 2024

Hello @alistairsellar and @ehogan!

I have committed my first draft of this here 1f52310

🥳

I have some questions it would be helpful if you could address

  1. Should we add instructions for what to do when the recipe throws an error that it needs the user to download missing data?

Perhaps we could add a "Prerequisites" section that says "To follow these instructions, you must be able to successfully run the recipe you want to add to the RTW" or equivalent? 🤔

  1. Do we need to run esmvaltool run locally first if we're getting the time/mem results from cylc review?

I think we need to run esmvaltool locally first to set the time and memory values in the first place, then I think we should get people to check Cylc Review after the first run to make sure the values aren't drastically different (and use the values from Cylc Review in the comment).

  1. I haven't run ESMValTool on JASMIN myself so unsure how much detail to go into for this in the documentation?

I don't think it's necessary to go into any detail here, personally. (As mentioned under 1., I would argue that it would be expected that people can successfully run their recipe.)

  1. Is kgo_rootpath site specific? (does it change between sites or is it always the same directory /data/users/esmval/KGO)?

Yes, it's defined in the site-specific files in the esmvaltool/utils/recipe_test_workflow/recipe_test_workflow/opt/ directory, see, e.g. esmvaltool/utils/recipe_test_workflow/recipe_test_workflow/opt/rose-suite-metoffice.conf file 😊

@alistairsellar
Copy link
Contributor

Hello @alistairsellar and @ehogan!

I have committed my first draft of this here 1f52310

Great! Hope to take a look later today.

I agree with @ehogan's answers above. On 1 & 3, these instructions are for adding a working recipe to RTW, so fundamental problems running the recipe are out of scope.

Copy link
Contributor

@alistairsellar alistairsellar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work - thanks @mo-gill!

A couple of suggestions from me, please.

@mo-gill
Copy link
Contributor Author

mo-gill commented May 27, 2024

Added pydata-sphinx-theme to the environment via the rtw-env.yml and the lock file in commit 8c82530, to fix the build errors in the GitHub workflow

Copy link
Contributor

@alistairsellar alistairsellar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Ed - great work!

@mo-gill mo-gill marked this pull request as ready for review May 28, 2024 11:17
@mo-gill mo-gill requested a review from ehogan June 21, 2024 14:19
Copy link
Contributor

@ehogan ehogan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Many thanks for your hard work on this @mo-gill! 🎉

@ehogan ehogan merged commit 61b0f40 into recipe_test_workflow_prototype Jun 25, 2024
9 checks passed
@ehogan ehogan deleted the 3074_create_how_to_add_recipe_docs branch June 25, 2024 13:47
@alistairsellar
Copy link
Contributor

Great work @mo-gill! Great to have these instructions in place!

@ehogan ehogan linked an issue Jun 25, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add how to add a recipe documentation
4 participants