Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.9.1 - Gymnasium and Mujoco #324

Merged
merged 28 commits into from
Mar 17, 2024
Merged

v0.9.1 - Gymnasium and Mujoco #324

merged 28 commits into from
Mar 17, 2024

Conversation

cpnota
Copy link
Owner

@cpnota cpnota commented Mar 17, 2024

Version 0.9.1. Updates several of the major dependencies, including:

  • Adds Gymnasium support
  • Adds Mujoco support
  • Adds hyperparameters logging after running experiments
  • Some other minor improvements to logging
  • Tweaks to SAC/DDPG hyperparameters and implementation
  • Minor workflow improvements
  • Some other dependency upgrades, including upgrading to torch~=2.2
  • Some minor bugfixes

* change opencv dependency to headless and upgrade to version 4

* revert test changes
* Release/0.8.2 (#276)

* change opencv dependency to headless and upgrade to version 4 (#275)

* change opencv dependency to headless and upgrade to version 4

* revert test changes

* version 0.8.2

* switch to gymnasium and update imports

* update state and state test

* update atari and duplicate env

* delete direct atari model test

* update vector env

* support legacy pybullet env

* update multiagent pettingzoo

* fix multi-agent atari

* fix ma atari preset test

* fix single_env_experiment tests

* update parallel env experiment test

* update multiagent env experiment test

* run formatter

* remove legacy gym import

* add legacy gym dependency

* specify pybullet gym dependency correctly

* update to pong_v3 in multiagent integration test
* add mujoco depnedency

* add MujocoEnvironment

* fix integration tests

* linting

* update docs version number
* all scripts to all package

* fix watch scripts

* update watch script and add test

* formatting

* compute sem correctly

* fix multiagent atari watch

* add additional random seed

* explicitly seed multiagent environment

* make test less flakey
* add __call__ method to Builder API and unit tests

* formatting
* loosen requirements of mujoco test

* log training episode length

* update parallel env training episode length tests

* update single env episode length tests

* log test episode length in single env experiment

* remove unwanted print from tests

* run formatter

* print episode length to console during training
* add entropy_backups hyperparameter to SAC

* run formatter
* use black formatter

* add isort

* remove unused imports

* add missing isort import
* fix key error warnings

* run formatter

* remove unused import
* update publish workflow and add alpha tag

* make sure setuptools and wheel are installed before publish

* add the required id-token permission

* update alpha version number
* add save_freq argument and refactor scripts

* run formatter

* fix test
* add initial add_hparams implementation

* add add_hparams to logger interface

* remove commit hash from run name

* re-organize tensorboard tags

* remove comet logger

* remove additional comet logger references

* remove logger kwarg

* fix multiagent env logging

* run formatter

* fix SingleEnvExperimentTest

* update parallel env test

* run formatter

* update multiagent env experimnet

* fix softmax test problem

* update torch version in workflows

* fix integration tests

* remove unwanted print

* run formatter
* sample actions for SacTest agent

* update sac default hyperparameters

* update ddpg default hyperparameters

* fix add_summary bug

* use more standard hyperparameters for ddpg and sac

* remove time body and adjust discount factor

* adjust sac default hyperparameters

* run formatter
* upgrade/adjust dependencies

* adjust required depenencies

* change maximum python version
…321)

* add swig setup dependency and remove unrar/swig from github scripts

* remove box2d dependency

* remove box2d envs from tests
* update benchmarks files

* merge

* use humanoid instead of swimmer

* make logdir match file name

* update torch version to minimum version supporting global_step in add_hparams

* update torch version for add_hparams update

* adjust slurm usage

* clip sac log_std

* adjust ddpg hyperparameters

* lower python version for deployment

* revert benchmark code to include all agents/envs

* rename benchmarks

* change initial sac temperature

* change pybullet logdir to match

* run linter

* add new benchmark results

* update docs
* update setup.py

* fix sphinx warnings

* edit handling of docs dependencies

* update docs to latest

* run formatter

* correct getting started doc

* remove script imports

* remove dev installation from .readthedocs.yml

* fix localhost link
@cpnota cpnota added this to the Release 0.9.1 milestone Mar 17, 2024
@cpnota cpnota merged commit ac81d00 into master Mar 17, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant