Code

OptimizedLinear updates#5791

Code

Merged

loadams merged 20 commits intomicrosoft:mastermicrosoft/DeepSpeed:masterfrom Snowflake-Labs:ds-llamaSnowflake-Labs/DeepSpeed:ds-llamaCopy head branch name to clipboardAug 14, 2024

+379-39

Commits

Commits on Jul 11, 2024

• Add fp8-fused gemm kernel

  sfc-gh-reyazda

  committed
  4c3b8fd

  Copy full SHA for 4c3b8fd

• add get_scale function

  sfc-gh-reyazda

  committed
  c0e97f1

  Copy full SHA for c0e97f1

• fix a few things to run the test

  sfc-gh-reyazda

  committed
  cb0e0a6

  Copy full SHA for cb0e0a6

• Merge branch 'master' into add-fp8-gemm

  sfc-gh-reyazda

  authored
  a11f9c5

  Copy full SHA for a11f9c5

Commits on Jul 12, 2024

• fixes for optim linear

  jeffra

  committed
  4169b13

  Copy full SHA for 4169b13

Commits on Jul 16, 2024

• progress

  jeffra

  committed
  5896743

  Copy full SHA for 5896743

Commits on Jul 17, 2024

• lora fixes + initial ckpt signal

  jeffra

  committed
  e600a38

  Copy full SHA for e600a38

Commits on Jul 18, 2024

• base_weight -> weight

  jeffra

  committed
  ef52cd1

  Copy full SHA for ef52cd1

• use flattened tensors for BWS

  jeffra

  committed
  a170fdd

  Copy full SHA for a170fdd

• fix illegal memory corner cases with an extra condition for reading scales

  

  sfc-gh-reyazda

  authored and

  jeffra

  committed
  390a984

  Copy full SHA for 390a984

• reduce memory pressure

  

  sfc-gh-reyazda

  authored and

  jeffra

  committed
  b43c242

  Copy full SHA for b43c242

Commits on Jul 23, 2024

• more changes

  jeffra

  committed
  40add9e

  Copy full SHA for 40add9e

Commits on Jul 24, 2024

• small fix for fp16 quantization

  

  sfc-gh-reyazda

  authored and

  jeffra

  committed
  057ce52

  Copy full SHA for 057ce52

Commits on Jul 31, 2024

• ds lora injection api support (#8)

  jeffra

  authored
  966ebd4

  Copy full SHA for 966ebd4

Commits on Aug 5, 2024

• Merge branch 'master' into ds-llama

  jeffra

  authored
  6ec4ead

  Copy full SHA for 6ec4ead

• various clean-up

  jeffra

  committed
  fe6b082

  Copy full SHA for fe6b082

Commits on Aug 6, 2024

• updates for tests

  jeffra

  committed
  c163c21

  Copy full SHA for c163c21

• Merge branch 'master' into ds-llama

  jeffra

  authored
  527cc23

  Copy full SHA for 527cc23

Commits on Aug 7, 2024

• Merge branch 'master' into ds-llama

  jeffra

  authored
  2bf3290

  Copy full SHA for 2bf3290

Commits on Aug 10, 2024

• Merge branch 'master' into ds-llama

  jeffra

  authored
  cbfd54d

  Copy full SHA for cbfd54d