Skip to content

Bug fixes and MoE training analysis support

Compare
Choose a tag to compare
@cli99 cli99 released this 31 Oct 07:55
· 28 commits to main since this release

This release fixes a few bugs when calculating memory usage (e.g. activation, optimizer states), and adds support to analysis MoE training.