Code

[MoE] Add TP and Mixtral MoE#19945

Code

Merged

wangyems merged 20 commits intomainmicrosoft/onnxruntime:mainfrom wangye/moe_tpmicrosoft/onnxruntime:wangye/moe_tpCopy head branch name to clipboardMar 20, 2024

+1,272-246

Commits

Commits on Mar 14, 2024

• mixtral moe

  wangyems

  committed
  956d40a

  Copy full SHA for 956d40a

• lint

  wangyems

  committed
  b8b09bd

  Copy full SHA for b8b09bd

Commits on Mar 15, 2024

• tp

  wangyems

  committed
  762980d

  Copy full SHA for 762980d

• update

  wangyems

  committed
  ab195f7

  Copy full SHA for ab195f7

• Merge branch 'main' of github.com:microsoft/onnxruntime into wangye/moe_tp

  wangyems

  committed
  de31a1d

  Copy full SHA for de31a1d

Commits on Mar 16, 2024

• lint

  wangyems

  committed
  7ac166c

  Copy full SHA for 7ac166c

• fix mispell

  wangyems

  committed
  10dff34

  Copy full SHA for 10dff34

Commits on Mar 18, 2024

• update

  wangyems

  committed
  4f22215

  Copy full SHA for 4f22215

• attempt to fix win build

  wangyems

  committed
  cb68e6a

  Copy full SHA for cb68e6a

• fix tests

  wangyems

  committed
  d9c14e0

  Copy full SHA for d9c14e0

Commits on Mar 19, 2024

• update

  wangyems

  committed
  4341a6a

  Copy full SHA for 4341a6a

• lint

  wangyems

  committed
  05ec59f

  Copy full SHA for 05ec59f

• Merge branch 'main' of github.com:microsoft/onnxruntime into wangye/moe_tp

  wangyems

  committed
  34e7cd9

  Copy full SHA for 34e7cd9

• fix pipelines

  wangyems

  committed
  c9780e5

  Copy full SHA for c9780e5

• use size_t

  wangyems

  committed
  5570d6a

  Copy full SHA for 5570d6a

• Merge branch 'main' of github.com:microsoft/onnxruntime into wangye/moe_tp

  wangyems

  committed
  69f53b8

  Copy full SHA for 69f53b8

• review comments

  wangyems

  committed
  42de225

  Copy full SHA for 42de225

Commits on Mar 20, 2024

• Update ContribOperators.md

  wangyems

  authored
  a6c5867

  Copy full SHA for a6c5867

• lint

  wangyems

  committed
  8f491e3

  Copy full SHA for 8f491e3

• fix orttraining pipeline

  wangyems

  committed
  e5d7b7d

  Copy full SHA for e5d7b7d