Code

Binary KQ mask#28

Code

Draft

ikawrakow wants to merge 13 commits intomainikawrakow/ik_llama.cpp:mainfrom ik/kq_maskikawrakow/ik_llama.cpp:ik/kq_maskCopy head branch name to clipboard

+977-109

Commits

Commits on Aug 27, 2024

• WIP: play with KQ mask - make it fp16

  Kawrakow

  committed
  0f30112

  Copy full SHA for 0f30112

• WIP

  Kawrakow

  committed
  16b8d3d

  Copy full SHA for 16b8d3d

Commits on Aug 28, 2024

• WIP: play with KQ mask - make it binary

  Show description for 511c459
  Kawrakow

  committed
  511c459

  Copy full SHA for 511c459

• WIP KQ binary mask: CUDA

  Show description for 1216a43
  Kawrakow

  committed
  1216a43

  Copy full SHA for 1216a43

• WIP KQ binary mask: for now, just use fp16 when flash attention is on

  Kawrakow

  committed
  62d6ef2

  Copy full SHA for 62d6ef2

• WIP KQ binary mask: Metal

  Show description for 900a39b
  Kawrakow

  committed
  900a39b

  Copy full SHA for 900a39b

• WIP KQ binary mask: Metal soft_max

  Show description for fe825ec
  Kawrakow

  committed
  fe825ec

  Copy full SHA for fe825ec

• WIP KQ binary mask: make it a parameter, turn on via command line

  Show description for 05f9522
  Kawrakow

  committed
  05f9522

  Copy full SHA for 05f9522

• Minor

  Kawrakow

  committed
  a8b762d

  Copy full SHA for a8b762d

• WIP KQ binary mask

  Kawrakow

  committed
  316345c

  Copy full SHA for 316345c

• WIP KQ binary mask

  Kawrakow

  committed
  97dbc16

  Copy full SHA for 97dbc16

• WIP KQ binary mask

  Kawrakow

  committed
  4d10f4e

  Copy full SHA for 4d10f4e

• Minor

  Kawrakow

  committed
  3b4fe65

  Copy full SHA for 3b4fe65