WeatherBench2 Evaluation Quickstart Runtime

[adominious]

No description provided.

[adominious]

Apologies for the formatting.

When running through the google colab, the evaluate_in_memory step has been running for around 15 mins, should it take this long or am I missing something?

Additionally, when trying the evaluate_with_beam option instead, it errors with the following:

NameError                                 Traceback (most recent call last)

[<ipython-input-19-6952d5173aaa>](https://localhost:8080/#) in <cell line: 1>()
----> 1 evaluation.evaluate_with_beam(
      2     data_config,
      3     eval_configs,
      4     runner='DirectRunner',
      5     input_chunks={'time': 20},

NameError: name 'evaluation' is not defined