Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🕊️ Migration PPOv2 -> PPO #2174

Merged
merged 41 commits into from
Oct 11, 2024
Merged

🕊️ Migration PPOv2 -> PPO #2174

merged 41 commits into from
Oct 11, 2024

Commits on Oct 4, 2024

  1. delete old ppo

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    8703f27 View commit details
    Browse the repository at this point in the history

  2. rename ppov2 files

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    12c1967 View commit details
    Browse the repository at this point in the history

  3. PPOv2 -> PPO

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    dad4b8b View commit details
    Browse the repository at this point in the history

  4. rm old doc

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    5553df7 View commit details
    Browse the repository at this point in the history

  5. rename ppo doc file

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    2371762 View commit details
    Browse the repository at this point in the history

  6. rm old test

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    abea746 View commit details
    Browse the repository at this point in the history

  7. rename test

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    1cde8b8 View commit details
    Browse the repository at this point in the history

  8. re-add v2 with deprecation

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    be9eb85 View commit details
    Browse the repository at this point in the history

  9. style

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    1c07333 View commit details
    Browse the repository at this point in the history

  10. start update customization

    @qgallouedec
    qgallouedec committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    655af26 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    ad8ddac View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    4ee7e55 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'migration-ppo' of https://github.com/huggingface/trl in… 

    …to migration-ppo
    @qgallouedec
    qgallouedec committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    adbc1a0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    c59e636 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    de20892 View commit details
    Browse the repository at this point in the history

  5. Lion

    @qgallouedec
    qgallouedec committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    6babb75 View commit details
    Browse the repository at this point in the history

  6. Finish update customization

    @qgallouedec
    qgallouedec committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    b7d0008 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    d79e5ab View commit details
    Browse the repository at this point in the history

  2. remove ppo_multi_adaptater

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    ff56032 View commit details
    Browse the repository at this point in the history

  3. remove ppo example

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b5c725c View commit details
    Browse the repository at this point in the history

  4. update some doc

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    447de7a View commit details
    Browse the repository at this point in the history

  5. Merge branch 'migration-ppo' of https://github.com/huggingface/trl in… 

    …to migration-ppo
    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    111c5fb View commit details
    Browse the repository at this point in the history

  6. rm test no peft

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    7e32b7b View commit details
    Browse the repository at this point in the history

  7. rm hello world

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    5ad70d7 View commit details
    Browse the repository at this point in the history

  8. processing class

    @qgallouedec
    qgallouedec committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    45f4dff View commit details
    Browse the repository at this point in the history

  9. Update docs/source/detoxifying_a_lm.mdx 

    Co-authored-by: Edward Beeching <[email protected]>
    @qgallouedec @edbeeching
    qgallouedec and edbeeching authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1536812 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    81cbd3a View commit details
    Browse the repository at this point in the history

  11. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    6d17e2c View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    babaae2 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Update trl/trainer/ppov2_config.py 

    Co-authored-by: Edward Beeching <[email protected]>
    @qgallouedec @edbeeching
    qgallouedec and edbeeching authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    c10918f View commit details
    Browse the repository at this point in the history

  2. Update docs/source/customization.mdx 

    Co-authored-by: lewtun <[email protected]>
    @qgallouedec @lewtun
    qgallouedec and lewtun authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    1762245 View commit details
    Browse the repository at this point in the history

  3. Update docs/source/detoxifying_a_lm.mdx 

    Co-authored-by: lewtun <[email protected]>
    @qgallouedec @lewtun
    qgallouedec and lewtun authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    b78995c View commit details
    Browse the repository at this point in the history

  4. po to example overview

    @qgallouedec
    qgallouedec committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    fd77f55 View commit details
    Browse the repository at this point in the history

  5. drop lion

    @qgallouedec
    qgallouedec committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    f43896a View commit details
    Browse the repository at this point in the history

  6. remove "Use 8-bit optimizer"

    @qgallouedec
    qgallouedec committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    9bfab24 View commit details
    Browse the repository at this point in the history

  7. Update docs/source/customization.mdx

    @qgallouedec
    qgallouedec authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    3f2cf5e View commit details
    Browse the repository at this point in the history

  8. Update docs/source/customization.mdx 

    Co-authored-by: lewtun <[email protected]>
    @qgallouedec @lewtun
    qgallouedec and lewtun authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    602d197 View commit details
    Browse the repository at this point in the history

  9. it applies to all trainers

    @qgallouedec
    qgallouedec committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    59515ca View commit details
    Browse the repository at this point in the history

  10. Merge branch 'migration-ppo' of https://github.com/huggingface/trl in… 

    …to migration-ppo
    @qgallouedec
    qgallouedec committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    f92017c View commit details
    Browse the repository at this point in the history

  11. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    c4b90ed View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into migration-ppo

    @qgallouedec
    qgallouedec authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    d8bed84 View commit details
    Browse the repository at this point in the history