Code

[WIP] FP8 support.#1484

Code

Closed

Narsil wants to merge 7 commits intomainhuggingface/text-generation-inference:mainfrom fp8huggingface/text-generation-inference:fp8Copy head branch name to clipboard

+50

Commits

Commits on Feb 1, 2024

• Initial fp8.

  Narsil

  committed
  a15ceb2

  Copy full SHA for a15ceb2

• Dummy but working version.

  Narsil

  committed
  081457f

  Copy full SHA for 081457f

• Updating docs.

  Narsil

  committed
  d90383d

  Copy full SHA for d90383d

• typo removal.

  Narsil

  committed
  7b38ca4

  Copy full SHA for 7b38ca4

• Marking the flag as really not the fastest and BETA.

  Narsil

  committed
  3e26028

  Copy full SHA for 3e26028

• Forgot to update docs.

  Narsil

  committed
  5267fac

  Copy full SHA for 5267fac

• Update docs2.

  Narsil

  committed
  1d15901

  Copy full SHA for 1d15901