Skip to content

Commit

Permalink
add sharded data parallel all gather time estimation (#15)
Browse files Browse the repository at this point in the history 
* wip

* add sharded dp allgather time

* fix tests
  • Loading branch information
@cli99
cli99 authored Nov 14, 2023
1 parent 0571436 commit 3e842f6
Show file tree
Hide file tree
Showing 3 changed files with 181 additions and 70 deletions.
Loading

0 comments on commit 3e842f6

Please sign in to comment.