Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enabling data-parallel multi-GPU training #1188

Merged
merged 16 commits into from
Jul 10, 2023
Merged

Enabling data-parallel multi-GPU training #1188

merged 16 commits into from
Jul 10, 2023

Commits on Jul 5, 2023

  1. First pass over multi-GPU

    @marcromeyn
    marcromeyn committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    e00799d View commit details
    Browse the repository at this point in the history

  2. Multi-gpu test passes now locally (without metric calculations)

    @marcromeyn
    marcromeyn committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    c972549 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Introducing MultiLoader & add auto-initialization of Model

    @marcromeyn
    marcromeyn committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    ba430d5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into torch/multi-gpu

    @marcromeyn
    marcromeyn authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    3829127 View commit details
    Browse the repository at this point in the history

  3. Enable multi-GPU with metric-calculations

    @marcromeyn
    marcromeyn committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    fdd6adb View commit details
    Browse the repository at this point in the history

  4. Remove un-used to method in ModelOutput

    @marcromeyn
    marcromeyn committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    c1d97b7 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'torch/multi-gpu' of github.com:NVIDIA-Merlin/models int… 

    …o torch/multi-gpu
    @marcromeyn
    marcromeyn committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    12418c8 View commit details
    Browse the repository at this point in the history

  6. fix test for cpu

    @edknv
    edknv committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    c317f88 View commit details
    Browse the repository at this point in the history

  7. use multigpu marker

    @edknv
    edknv committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    1645bb9 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into torch/multi-gpu

    @edknv
    edknv authored Jul 6, 2023
    Configuration menu
    Copy the full SHA
    0365bed View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. automatically reparition if repartition is not provided

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    2d1112e View commit details
    Browse the repository at this point in the history

  2. test rank

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    8f308e9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into torch/multi-gpu

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    1628557 View commit details
    Browse the repository at this point in the history

  4. Add comment for follow up tasks

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    49c2674 View commit details
    Browse the repository at this point in the history

  5. lint

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    3e5ac66 View commit details
    Browse the repository at this point in the history

  6. fix test for cpu

    @edknv
    edknv committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    4e80c77 View commit details
    Browse the repository at this point in the history