Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: add algo aurora #144

Merged
merged 30 commits into from
Dec 11, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
1aba76e
WIP: add all aurora components - passes tests
felixchalumeau Feb 27, 2023
a86bdb0
WIP - first cleaning
felixchalumeau Feb 28, 2023
4d4955c
fix pre-commits
felixchalumeau Feb 28, 2023
27def80
WIP - example notebook
felixchalumeau Feb 28, 2023
86a19a0
fix hyperparams issue - clean example notebook
felixchalumeau Feb 28, 2023
955a081
fix brax version issue with halfcheetah
felixchalumeau Mar 1, 2023
5adb3a4
update readme
felixchalumeau Mar 1, 2023
a67ef6a
add docs and pga aurora example
felixchalumeau Mar 1, 2023
03bda2c
add docstrings + clean + move seq2seq model
felixchalumeau Mar 1, 2023
9bbcf0a
minor fix - trigger ci
felixchalumeau Mar 2, 2023
4b6c4ec
upgrade action in ci
felixchalumeau Mar 2, 2023
d132944
update isort
felixchalumeau Mar 2, 2023
88bb231
fix path to seq2seq
felixchalumeau Mar 2, 2023
1c59bcd
Merge branch 'develop' into feat/add-algo-aurora
Lookatator Apr 18, 2023
5d93322
removing ages and centroids and add max_size
Lookatator Apr 20, 2023
8293057
refactoring bd and obs generation
Lookatator Apr 23, 2023
7294c51
put training and csc inside AURORA
Lookatator Apr 23, 2023
94e1f8a
Merge branch 'feat/add-algo-aurora' of github.com:adaptive-intelligen…
Lookatator Apr 24, 2023
b0aba19
Add missing comments and refactor tests
Lookatator Apr 25, 2023
9873f48
fix style
Lookatator Apr 25, 2023
3626a18
make it run
Lookatator Apr 25, 2023
2606c86
make it work
Lookatator Apr 25, 2023
1b06020
passes style and tests
Lookatator Apr 25, 2023
fc2e3c0
using right version of brax
Lookatator Apr 26, 2023
999b273
update dependencies and change order of docs dependencies installations
Lookatator Apr 26, 2023
a1bcd30
adding jaxlib to requirements
Lookatator Apr 27, 2023
0a9ed35
Merge branch 'develop' into feat/add-algo-aurora
Lookatator Dec 10, 2023
d5aa679
Merge branch 'develop' into feat/add-algo-aurora
Lookatator Dec 10, 2023
a0307a3
adapt LSTMCell usage to new RNNCellBase Upgrade
Lookatator Dec 11, 2023
6c5801e
add missing docstrings
Lookatator Dec 11, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -123,6 +123,7 @@ repertoire.genotypes, repertoire.fitnesses, repertoire.descriptors
## QDax core algorithms
QDax currently supports the following algorithms:


| Algorithm | Example |
|-------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [MAP-Elites](https://arxiv.org/abs/1504.04909) | [![Open All Collab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/adaptive-intelligent-robotics/QDax/blob/main/examples/mapelites.ipynb) |
Expand All @@ -138,7 +139,6 @@ QDax currently supports the following algorithms:
| [MAP-Elites Low-Spread (ME-LS)](https://dl.acm.org/doi/abs/10.1145/3583131.3590433) | [![Open All Collab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/adaptive-intelligent-robotics/QDax/blob/main/examples/me_ls.ipynb) |



## QDax baseline algorithms
The QDax library also provides implementations for some useful baseline algorithms:

Expand Down
7 changes: 7 additions & 0 deletions docs/api_documentation/core/aurora.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# AURORA class

This class implement the base mechanism of AURORA. It must be used with an emitter. To get the usual AURORA algorithm, one must use the [mixing emitter](emitters.md#qdax.core.emitters.standard_emitters.MixingEmitter).

The AURORA class can be used with other emitters to create variants, like [PGA-AURORA](pga_aurora.md).

::: qdax.core.aurora.AURORA
5 changes: 5 additions & 0 deletions docs/api_documentation/core/pga_aurora.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Policy Gradient Assisted AURORA (PGA-AURORA)

To create an instance of PGA-AURORA (introduced [in this paper](https://arxiv.org/abs/2210.03516)), one needs to use an instance of [AURORA](map_elites.md) with the PGAMEEmitter, detailed below.

::: qdax.core.emitters.pga_me_emitter.PGAMEEmitter
Loading
Loading