Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add CrossQ #28

Merged
merged 41 commits into from
Apr 3, 2024
Merged

Add CrossQ #28

merged 41 commits into from
Apr 3, 2024

Commits on Dec 12, 2023

  1. Added support for large values for gradient_steps to SAC, TD3, and TQ… 

    …C by replacing the unrolled loop with jax.lax.fori_loop
    @jan1854
    jan1854 committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    34106cb View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Merge branch 'master' into master

    @araffin
    araffin authored Dec 13, 2023
    Configuration menu
    Copy the full SHA
    7d3f328 View commit details
    Browse the repository at this point in the history

  2. Add comments

    @araffin
    araffin committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    36febf0 View commit details
    Browse the repository at this point in the history

  3. Hotfix for train signature

    @araffin
    araffin committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    dbe8760 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. Fixed start index for dynamic_slice_in_dim

    @jan1854
    jan1854 committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    4cd5f27 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. Merge branch 'master' into jan1854/master

    @araffin
    araffin committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    a705e4f View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. Merge branch 'master' into master

    @araffin
    araffin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    8fb4647 View commit details
    Browse the repository at this point in the history

  2. Rename policy delay

    @araffin
    araffin committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    3066fb2 View commit details
    Browse the repository at this point in the history

  3. Fix type annotation

    @araffin
    araffin committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    fe68677 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. Add CrossQ POC

    @araffin
    araffin committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    5fef7e4 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. Remove old annotations

    @araffin
    araffin committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    4667216 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Add actor BN

    @araffin
    araffin committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    e2c2fd8 View commit details
    Browse the repository at this point in the history

  2. Concatenate obs/next obs, first working example

    @araffin
    araffin committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    03ba862 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Deactivate batchnorm for actor

    @araffin
    araffin committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    1533ae5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/crossq

    @araffin
    araffin committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    695dcc4 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Merge branch 'master' into master

    @araffin
    araffin authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    6504fe9 View commit details
    Browse the repository at this point in the history

  2. Fix off-by-one and improve type annotation

    @araffin
    araffin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    bfbe00b View commit details
    Browse the repository at this point in the history

  3. Fix typo

    @araffin
    araffin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    de56192 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'jan1854/master' into feat/crossq

    @araffin
    araffin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    31be655 View commit details
    Browse the repository at this point in the history

  5. Update type annotation

    @araffin
    araffin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    2f76b77 View commit details
    Browse the repository at this point in the history

  6. Update off-by one

    @araffin
    araffin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    49fbced View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Merge branch 'master' into feat/crossq

    @araffin
    araffin committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    32b7b99 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Merge branch 'master' into feat/crossq

    @araffin
    araffin authored Mar 6, 2024
    Configuration menu
    Copy the full SHA
    cd02332 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Implemented CrossQ

    @danielpalen
    danielpalen committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    7f5dd22 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Added CrossQ to README

    @danielpalen
    danielpalen committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    e73cf2e View commit details
    Browse the repository at this point in the history

  2. clean up and comments

    @danielpalen
    danielpalen committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    74af2ea View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. refactored and added comments

    @danielpalen
    danielpalen committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    13565d7 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. Update doc

    @araffin
    araffin committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    c6e75da View commit details
    Browse the repository at this point in the history

  2. Cleanup CrossQ and BatchRenorm

    @araffin
    araffin committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    f2d4e27 View commit details
    Browse the repository at this point in the history

  3. Update tests

    @araffin
    araffin committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    ddc6c90 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Merge pull request #36 from danielpalen/feat/crossq 

    Implemented CrossQ
    @araffin
    araffin authored Mar 29, 2024
    Configuration menu
    Copy the full SHA
    e9262a1 View commit details
    Browse the repository at this point in the history

  2. Fix for new tfp version

    @araffin
    araffin committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    deabd7f View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2024

  1. Clean-up: Removed unused variables and fixed typo

    @jan1854
    jan1854 committed Mar 30, 2024
    Configuration menu
    Copy the full SHA
    de80349 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2024

  1. Cleaner variable names for BatchReNorm 

    Co-authored-by: Jan Schneider <[email protected]>
    @araffin @jan1854
    araffin and jan1854 authored Mar 31, 2024
    Configuration menu
    Copy the full SHA
    55d60e3 View commit details
    Browse the repository at this point in the history

  2. Allow to change the number of warmup steps

    @araffin
    araffin committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    2ef9dbe View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feat/crossq

    @araffin
    araffin authored Mar 31, 2024
    Configuration menu
    Copy the full SHA
    3032a97 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Update SB3 dependency

    @araffin
    araffin committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    289eb47 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/crossq' of github.com:araffin/sbx into feat/crossq

    @araffin
    araffin committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    726fcbe View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'master' into feat/crossq

    @araffin
    araffin committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    f1426cd View commit details
    Browse the repository at this point in the history

  2. Deprecate DroQ class

    @araffin
    araffin committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    a7b3135 View commit details
    Browse the repository at this point in the history

  3. [ci skip] Update comments

    @araffin
    araffin committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    8cc748f View commit details
    Browse the repository at this point in the history