Code

Adding the new feature of FPDT#6462

Code

Merged

loadams merged 74 commits intomicrosoft:mastermicrosoft/DeepSpeed:masterfrom YJHMITWEB:masterYJHMITWEB/DeepSpeed:masterCopy head branch name to clipboardDec 4, 2024

+1,432-2

Commits

Commits on Aug 3, 2024

• fix the bug of deepspeed sequence parallel working with batch size larger than 1

  

  Jinghan Yao

  committed
  c076827

  Copy full SHA for c076827

Commits on Aug 6, 2024

• Merge branch 'master' into master

  samadejacobs

  authored
  1b8a8c1

  Copy full SHA for 1b8a8c1

Commits on Aug 7, 2024

• apply yapf formatting

  

  Jinghan Yao

  committed
  ed34e89

  Copy full SHA for ed34e89

• Formatting fixes

  loadams

  committed
  89b119e

  Copy full SHA for 89b119e

Commits on Aug 28, 2024

• Merge branch 'microsoft:master' into master

  YJHMITWEB

  authored
  7db5798

  Copy full SHA for 7db5798

Commits on Aug 29, 2024

• add FPDT

  

  Jinghan Yao

  committed
  0beff24

  Copy full SHA for 0beff24

• Merge branch 'master' into master

  YJHMITWEB

  authored
  4522ed7

  Copy full SHA for 4522ed7

Commits on Sep 6, 2024

• Merge branch 'master' into master

  tjruwase

  authored
  c15d1d8

  Copy full SHA for c15d1d8

Commits on Sep 24, 2024

• modify streams

  

  Jinghan Yao

  committed
  69f3892

  Copy full SHA for 69f3892

• modify streams

  

  Jinghan Yao

  committed
  8ef9f5a

  Copy full SHA for 8ef9f5a

Commits on Sep 27, 2024

• Merge branch 'master' into master

  loadams

  authored
  b43c5ec

  Copy full SHA for b43c5ec

Commits on Oct 7, 2024

• remove duplication of alltoall

  

  Jinghan Yao

  committed
  a55d1f5

  Copy full SHA for a55d1f5

• Merge branch 'master' of github.com:YJHMITWEB/DeepSpeed

  

  Jinghan Yao

  committed
  1cbd59d

  Copy full SHA for 1cbd59d

• remove duplication of pos

  

  Jinghan Yao

  committed
  6bfd76f

  Copy full SHA for 6bfd76f

• fix format

  

  Jinghan Yao

  committed
  4eeadca

  Copy full SHA for 4eeadca

Commits on Oct 10, 2024

• Merge branch 'master' into master

  tohtana

  authored
  8994991

  Copy full SHA for 8994991

• fix format and add unit test for fpdt

  

  Jinghan Yao

  committed
  128286c

  Copy full SHA for 128286c

• Merge branch 'master' of github.com:YJHMITWEB/DeepSpeed

  Show description for 386f606
  

  Jinghan Yao

  committed
  386f606

  Copy full SHA for 386f606

• add einops

  

  Jinghan Yao

  committed
  ebea5b0

  Copy full SHA for ebea5b0

Commits on Oct 11, 2024

• add flashattn

  

  Jinghan Yao

  committed
  5c8eec8

  Copy full SHA for 5c8eec8

• Merge branch 'master' into master

  tohtana

  authored
  a7e175a

  Copy full SHA for a7e175a

Commits on Oct 14, 2024

• add requirements for flash-attn in FPDT

  

  Jinghan Yao

  committed
  764a572

  Copy full SHA for 764a572

• Merge branch 'master' of github.com:YJHMITWEB/DeepSpeed

  Show description for 14e91b8
  

  Jinghan Yao

  committed
  14e91b8

  Copy full SHA for 14e91b8

Commits on Oct 17, 2024

• Merge branch 'master' into master

  tohtana

  authored
  77dcd38

  Copy full SHA for 77dcd38

Commits on Oct 22, 2024

• Merge branch 'master' into master

  tohtana

  authored
  7a5c29c

  Copy full SHA for 7a5c29c

Commits on Nov 5, 2024

• skip test when fa is unavailable

  tohtana

  committed
  534cb93

  Copy full SHA for 534cb93

• formatting

  tohtana

  committed
  972ddda

  Copy full SHA for 972ddda

• add workflow to run a6000 tests

  tohtana

  committed
  37bc694

  Copy full SHA for 37bc694

• Merge branch 'master' into FPDT

  tohtana

  committed
  8f8aaa0

  Copy full SHA for 8f8aaa0

• revert world sizes for tests

  tohtana

  committed
  ac7baf6

  Copy full SHA for ac7baf6

• Merge pull request #1 from YJHMITWEB/tohtana/merge_FPDT

  Show description for 0d2b624
  tohtana

  authored
  0d2b624

  Copy full SHA for 0d2b624

• update workflow

  tohtana

  committed
  8935529

  Copy full SHA for 8935529

• update image version

  tohtana

  committed
  edd2e05

  Copy full SHA for edd2e05

• remove --no-build-isolation

  tohtana

  committed
  464d117

  Copy full SHA for 464d117

• remove requirements file for flash-attn

  tohtana

  committed
  7389f66

  Copy full SHA for 7389f66

• remove flash-attn requirements from setup.py

  tohtana

  committed
  5f859be

  Copy full SHA for 5f859be

• fix pip command

  tohtana

  committed
  56cb647

  Copy full SHA for 56cb647

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  164f459

  Copy full SHA for 164f459

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  3eb816d

  Copy full SHA for 3eb816d

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  2ae68dc

  Copy full SHA for 2ae68dc

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  b1b2688

  Copy full SHA for b1b2688

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  67aa3df

  Copy full SHA for 67aa3df

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  42461d2

  Copy full SHA for 42461d2

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  d637d60

  Copy full SHA for d637d60

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  907c79d

  Copy full SHA for 907c79d

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  8f5d039

  Copy full SHA for 8f5d039

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  02c2fbf

  Copy full SHA for 02c2fbf

• modify unit test for fpdt

  

  Jinghan Yao

  committed
  f570213

  Copy full SHA for f570213

• add condition for using fpdt offloading

  

  Jinghan Yao

  committed
  5b8c419

  Copy full SHA for 5b8c419

• add condition for using fpdt offloading

  

  Jinghan Yao

  committed
  bd090c8

  Copy full SHA for bd090c8

• add flash-attn version check

  

  Jinghan Yao

  committed
  e48e85b

  Copy full SHA for e48e85b

Commits on Nov 6, 2024

• Merge branch 'master' into master

  tohtana

  authored
  af24777

  Copy full SHA for af24777

• add unit test directory as test trigger

  tohtana

  committed
  ebaf56c

  Copy full SHA for ebaf56c

• add cron for test and reporting for nightly CI failures

  tohtana

  committed
  9e811b8

  Copy full SHA for 9e811b8

Commits on Nov 7, 2024

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  a7522da

  Copy full SHA for a7522da

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  209adab

  Copy full SHA for 209adab

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  dbeea8a

  Copy full SHA for dbeea8a

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  845e42d

  Copy full SHA for 845e42d

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  8b2549c

  Copy full SHA for 8b2549c

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  058c973

  Copy full SHA for 058c973

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  0dcc234

  Copy full SHA for 0dcc234

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  d1be5d3

  Copy full SHA for d1be5d3

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  3a0feba

  Copy full SHA for 3a0feba

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  8c57812

  Copy full SHA for 8c57812

Commits on Nov 8, 2024

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  43decf6

  Copy full SHA for 43decf6

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  d39585c

  Copy full SHA for d39585c

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  389b1a3

  Copy full SHA for 389b1a3

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  958f3bf

  Copy full SHA for 958f3bf

• add multiGPU fpdt unit test

  

  Jinghan Yao

  committed
  af025c5

  Copy full SHA for af025c5

• Merge branch 'master' into master

  tohtana

  authored
  2230377

  Copy full SHA for 2230377

Commits on Nov 25, 2024

• Merge branch 'master' into master

  tohtana

  authored
  7636690

  Copy full SHA for 7636690

Commits on Dec 3, 2024

• Merge branch 'master' into master

  loadams

  authored
  10cdc5f

  Copy full SHA for 10cdc5f

Commits on Dec 4, 2024

• Merge branch 'master' into master

  loadams

  authored
  b2175a4

  Copy full SHA for b2175a4

• Merge branch 'master' into master

  loadams

  authored
  1e801ce

  Copy full SHA for 1e801ce