DeepSpeed v0.3.15

jeffra released this 19 Apr 16:31

· 2058 commits to master since this release

v0.3.15 Release notes

ZeRO-Infinity release allowing nvme offload and more!
Deprecated cpu_offload in config JSON, see JSON docs for more details.
Automatic external parameter registration, more details in the ZeRO 3 docs.
Several bug fixes for ZeRO stage 3

Assets 2