New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MoE] Add TP and Mixtral MoE #19945

Merged

wangyems merged 20 commits into main from wangye/moe_tp

Mar 20, 2024

Merged

[MoE] Add TP and Mixtral MoE #19945

fix orttraining pipeline

Azure Pipelines / Windows GPU TensorRT CI Pipeline succeeded Mar 20, 2024 in 1h 41m 11s

Build #20240319.34 succeeded

0 errors / 521 warnings

Details

Failed: 0 (0.00%)
Passed: 69 (93.24%)
Other: 5 (6.76%)
Total: 74

View more details on Azure Pipelines