Skip to content

v1.0.1
Compare
Choose a tag to compare
@laekov laekov released this 30 May 06:16
· 40 commits to master since this release
v1.0.1
c9ccc0e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Compatibility

  • PyTorch 2.0 supported.
  • Megatron-LM 2.5 supported.

Documentation

Performance related

  • Generalize FasterMoE's schedule to n_expert > 1 and more bug fixes.
  • Synchronization reduction thanks to @Fragile-azalea

Contributors

Fragile-azalea and santurini
Assets 2
Loading