himo_example.ipynb contains code for the illustrative task of Section 3.2 in the paper.
This is a Colaboratory notebook:
If your runtime doesn't include Haiku and Tree please run the cell labeled "Install extra dependencies" which contains the following pip installation commands:
!pip install dm-haiku
!pip install dm-tree
Value-driven Hindsight Modelling Arthur Guez, Fabio Viola, Théophane Weber, Lars Buesing, Steven Kapturowski, Doina Precup, David Silver, and Nicolas Heess Neural Information Processing Systems 2020, URL: https://arxiv.org/abs/2002.08329