New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MoE] Add TP and Mixtral MoE #19945

Merged

wangyems merged 20 commits into main from wangye/moe_tp

Mar 20, 2024

Merged

[MoE] Add TP and Mixtral MoE #19945

fix orttraining pipeline

Azure Pipelines / orttraining-mac-ci-pipeline succeeded Mar 20, 2024 in 1h 56m 29s

Build #20240319.29 succeeded

0 errors / 0 warnings

Details

Failed: 0 (0.00%)
Passed: 3,821 (67.74%)
Other: 1,820 (32.26%)
Total: 5,641

View more details on Azure Pipelines