Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add more streamlined local and single_gpu support, allow use of 8 bit adam optimizer #57

Open
wants to merge 16 commits into
base: master
Choose a base branch
from
Open

Add more streamlined local and single_gpu support, allow use of 8 bit adam optimizer #57

wants to merge 16 commits into from

Commits on Feb 16, 2024

  1. tweaks to work local

    Andrew Suter-Morris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    46625b0 View commit details
    Browse the repository at this point in the history

  2. uncomment, more changes

    Andrew Suter-Morris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    15afedc View commit details
    Browse the repository at this point in the history

  3. check path

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    12fe393 View commit details
    Browse the repository at this point in the history

  4. print more

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    2160794 View commit details
    Browse the repository at this point in the history

  5. logs

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    e0fad36 View commit details
    Browse the repository at this point in the history

  6. Add checks for device, Local slurm id first, then cuda, then cpui

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    dd647c9 View commit details
    Browse the repository at this point in the history

  7. single gpu

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    46c494d View commit details
    Browse the repository at this point in the history

  8. barrier if not single gpu

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    90901e5 View commit details
    Browse the repository at this point in the history

  9. remove bitsandbytes for now

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    a48594b View commit details
    Browse the repository at this point in the history

  10. more fixes

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    2353ce1 View commit details
    Browse the repository at this point in the history

  11. cleanup sys

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    f4ef10c View commit details
    Browse the repository at this point in the history

  12. cleanup: remove unused imports

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    94c1730 View commit details
    Browse the repository at this point in the history

  13. setup 8bit adam

    @asutermo
    asutermo committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    39fee6d View commit details
    Browse the repository at this point in the history

  14. 8bit adam support, move config

    Andrew Suter-Morris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    900188c View commit details
    Browse the repository at this point in the history

  15. pathing

    Andrew Suter-Morris committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    f0c474c View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. don't allow single_gpu and fsdp

    Andrew Suter-Morris committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    cb4656d View commit details
    Browse the repository at this point in the history