AngoraPy 0.10.8

Anthropomorphic Task API

• Integrated new, adapted version of the MuJoCo Menagerie ShadowHand. Old policies trained on the previous hand model might not work with this newer model.
• Added dm_control dependency to programmatically build MuJoCo models. This does not replace the gym-basis of the API but extends it. However, while gym(nasium) will in the foreseeable future remain to be the standard by which Environments are communicated with in AngoraPy, we will move many interactions with MuJoCo to dm_control in the future. This should, however, not affect normal usage of AngoraPy.
• AnthropomorphicEnv can now accept a wider range of definitions of models of the agents body.
• Refactored methods of AnthropomorphicEnv and BaseShadowHandEnv such that methods that can be made use of in any anthropomorphic/hand task moved up the inheritance hierarchy from more specific classes.
• Added getters for senses to AnthropomorphicEnv and a default _get_obs()

Modeling API

• make_input_layers() now returns a dictionary mapping the name of the modality to the input layer
• Model registration now is achieved via decorators (@register_model('model_name'))

Backend

• Upgraded to TensorFlow 2.15.1, thus cuda will now be installed with AngoraPy (via TF)
• Improved model optimization during training.
• Fixed state resets during optimization and inference.

Deployment

• Updated Dockerfiles.

Misc

• Improved (experimental) pretraining.

Documentation

• We now maintain a list of major features in the README, where we will also include future features that we currently work on.

AngoraPy 0.9.1

Modeling

• Automized input construction API for model building. Use ´make_input_layers(...)fromangorapy.utilities.model_utils` to quickly construct input layers for the different modalities of your model. This approach is now also used by the builtin models.

Misc

• Updated requirements for improved simplicity during installation.
• Updated Readme
• Added unit tests for builtin models

AngoraPy 0.9.0

Modeling

• Simple, Wider, and Deeper models now support all input modalities.
• Experimental LiF function.
• Added a validator for model builders that is called when Agents are instantiated.

Environments

• Rolling out the policy now also records auxiliary metrics if the environment supports them in the returned info dictionary.

Analysis

• Several new experimental plotting functions.

AngoraPy 0.8.1

Environments

• Fixed rendering for reach environments (targets and fingertips are now properly shown)
• Added Hanoi task

Utilities

• Changed plotting utils
  • Plotting functions are not longer returning HTML/JS plots but more flexible bokeh objects, to be used for both web browser rendering and Jupyter notebooks, too.

Dependencies

• Bumped TensorFlow from 2.9.1 to 2.10.0

Misc

• Better pertaining on object pose

AngoraPy 0.8.0

New Features

• Added new policy distribution ReparameterizedBetaPolicyDistribution. It's a reparameterized version of the Beta distribution (who could have guessed) that predicts the mean and spread of the PDF instead of alpha and beta. This allows the spread to be controlled without input dependency, leading to more stability.
• Improved customizability of the Gatherer class. Gatherer now has a .postprocess() method called during data collection to postprocess data collected in the data buffer. The default buffer only normalizes advantages via this method, but custom gatherers can apply more postprocessing and even add or filter data to/from the buffer.

Monitoring

• New group view in the web monitor. Experiments now can be assigned an optional group name. The new view can investigate the mean reward progression of grouped experiments. More functionality on this will follow in future updates.
• Better filtering of experiments in the web monitor.
• The hyperparameter view now also shows Gatherer information
• Improved robustness against corrupted JSON files.

Other Changes

• Upgraded from TensorFlow 2.4.2 to 2.9.1. Should at this point still be backward-compatible though.
• Throughout optimization, several assertions have been added to simplify debugging when facing NaN/Inf values.
• Added new unit tests.

AngoraPy 0.7.1

Changelog

New Features/Improvements

• Added Docker support. The Dockerfile can be found at docker/. The Dockerfile currently expects you to build with this repository as context.
• Updated dependency on gym==0.24.0. This includes a rewrite of the dexterity environments using mujoco (deepmind's own bindings). These environments now do not anymore depend on the gym implementation but are native in angorapy.
• With the migration to mujoco, MuJoCo itself needs not to be installed manually anymore. Checks for installed MuJoCo have thus been changed and now depend on whether mujoco is installed.
• Added new variants of Manipulate (just registrations)
• Added new examples
• Added more information to the README
• Improved pull script
• The monitor now also stores hyperparameters set in the drill call (number of epochs and batch size)

Bugfixes

• Several bug fixes w.r.t. MuJoCo environments.
• Fixed automatic MuJoCo detection. AngoraPy now checks for either an existing .mujoco directory in your home directory or a set environment variable MUJOCO_PY_MUJOCO_PATH. If either exist, MuJoCo will be attempted to load.

Breaking changes

• Moved package data to angorapy, so all imports now are import angorapy instead of import dexterity. We recommend doing import angorapy as ang. Additional shortcuts to major function (e.g. make_env) have been added and will be in future releases.

HBP Knowledge Graph Release

0.6

Update CITATION.cff

HBP Model Catalog Initial Release

Cleaned up chiefinvestigator and made it inherit from investigator

however functionality to use the fixedpointfinder is removed for now.