Code

Merge from upstream#31

Code

Merged

l3utterfly merged 38 commits intolayla-buildl3utterfly/llama.cpp:layla-buildfrom masterl3utterfly/llama.cpp:masterCopy head branch name to clipboardAug 8, 2024

+2,226-773

Commits

Commits on Aug 2, 2024

• Fix conversion of unnormalized BF16->BF16 weights (ggerganov#7843)

  Show description for b72c20b
  

  CISC

  and

  compilade

  authored
  b72c20b

  Copy full SHA for b72c20b

Commits on Aug 3, 2024

• ggml : reading the runtime sve config of the cpu (ggerganov#8709)

  Show description for 76614f3
  

  jdomke

  and

  domke

  authored
  76614f3

  Copy full SHA for 76614f3

Commits on Aug 4, 2024

• flake.lock: Update (ggerganov#8847)

  ggerganov

  authored
  4b77ea9

  Copy full SHA for 4b77ea9

• baby-llama : remove duplicate vector include

  

  danbev

  authored and

  ggerganov

  committed
  01aae2b

  Copy full SHA for 01aae2b

• batched-bench : handle empty -npl (ggerganov#8839)

  Show description for ecf6b7f
  

  3 peopleauthored
  ecf6b7f

  Copy full SHA for ecf6b7f

• Server: Don't ignore llama.cpp params (ggerganov#8754)

  Show description for 978ba3d
  ardfork

  authored
  978ba3d

  Copy full SHA for 978ba3d

• Install curl in runtime layer (ggerganov#8693)

  bsquizz

  authored
  0d6fb52

  Copy full SHA for 0d6fb52

Commits on Aug 5, 2024

• cann: support q4_0 model (ggerganov#8822)

  wangshuai09

  authored
  c02b0a8

  Copy full SHA for c02b0a8

• ggml : move c parameter comment to ggml_rope_ext (ggml/901)

  Show description for 655858a
  

  danbev

  authored and

  ggerganov

  committed
  655858a

  Copy full SHA for 655858a

• vulkan : implement Stable Diffusion operators (ggml/904)

  Show description for a3738b2
  

  0cc4m

  authored and

  ggerganov

  committed
  a3738b2

  Copy full SHA for a3738b2

• sync : ggml

  Show description for 5587e57
  ggerganov

  committed
  5587e57

  Copy full SHA for 5587e57

• vulkan : fix Qantized Mat-Vec Mul on AMD GPUs for ncols < 64 (ggerganov#8855)

  Show description for 064cdc2
  0cc4m

  authored
  064cdc2

  Copy full SHA for 064cdc2

• llama : better replace_all (ggerganov#8852)

  ggerganov

  authored
  f1ea514

  Copy full SHA for f1ea514

• readme : update model list (ggerganov#8851)

  BarfingLemurs

  authored
  400ae6f

  Copy full SHA for 400ae6f

• cmake: fix paths for vulkan shaders compilation on Windows (ggerganov#8573)

  Show description for e31a4f6
  stduhpf

  authored
  e31a4f6

  Copy full SHA for e31a4f6

• Stop the generation when <|eom_id|> token is encountered - needed for Llama 3.1 tool call support (ggerganov#8858)

  Show description for d3f0c71
  

  fairydreaming

  and

  sszymczy

  authored
  d3f0c71

  Copy full SHA for d3f0c71

• py: Add more authorship metadata from model card (ggerganov#8810)

  Show description for 1ef14b3
  mofosyne

  authored
  1ef14b3

  Copy full SHA for 1ef14b3

• ggml : fix overflows in elu function (ggerganov#8866)

  Show description for b9dfc25
  jart

  authored
  b9dfc25

  Copy full SHA for b9dfc25

• readme : add ramalama to the availables UI (ggerganov#8811)

  Show description for b42978e
  ericcurtin

  authored
  b42978e

  Copy full SHA for b42978e

• cann: fix buffer_num and runtime speed slowly error (ggerganov#8865)

  wangshuai09

  authored
  bc0f887

  Copy full SHA for bc0f887

• common : Changed tuple to struct (TODO fix) (ggerganov#8823)

  Show description for 0a4ce78
  Septa2112

  authored
  0a4ce78

  Copy full SHA for 0a4ce78

Commits on Aug 6, 2024

• [SYCL] correct cmd name (ggerganov#8877)

  arthw

  authored
  d4ff847

  Copy full SHA for d4ff847

• [CANN]: Fix ggml_backend_cann_buffer_get_tensor (ggerganov#8871)

  Show description for c21a896
  MengqingCao

  authored
  c21a896

  Copy full SHA for c21a896

• convert : add support for XLMRoberta embedding models (ggerganov#8658)

  Show description for cdd1889
  iamlemec

  authored
  cdd1889

  Copy full SHA for cdd1889

• ggml : add epsilon as a parameter for group_norm (ggerganov#8818)

  Show description for 2d5dd7b
  MollySophia

  authored
  2d5dd7b

  Copy full SHA for 2d5dd7b

• contributing : add note about write access

  ggerganov

  authored
  0bf16de

  Copy full SHA for 0bf16de

• [Vulkan] Fix compilation of vulkan-shaders-gen on w64devkit after e31a4f6 (ggerganov#8880)

  Show description for efda90c
  MaggotHATE

  authored
  efda90c

  Copy full SHA for efda90c

• cmake : Link vulkan-shaders-gen with pthreads (ggerganov#8835)

  Show description for db20f50
  Patater

  authored
  db20f50

  Copy full SHA for db20f50

• simple : update name of executable to llama-simple (ggerganov#8885)

  Show description for 5f4dcb1
  danbev

  authored
  5f4dcb1

  Copy full SHA for 5f4dcb1

• CUDA: fix padding logic for FP16/FP32 (ggerganov#8884)

  JohannesGaessler

  authored
  641f5dd

  Copy full SHA for 641f5dd

• server : add lora hotswap endpoint (WIP) (ggerganov#8857)

  Show description for 1e6f655
  ngxson

  authored
  1e6f655

  Copy full SHA for 1e6f655

• typo correction (ggerganov#8891)

  Nexesenex

  authored
  3195854

  Copy full SHA for 3195854

• quantize : update usage comment in quantize.cpp (ggerganov#8889)

  Show description for 725e3d9
  danbev

  authored
  725e3d9

  Copy full SHA for 725e3d9

Commits on Aug 7, 2024

• llama-bench : add support for getting cpu info on Windows (ggerganov#8824)

  Show description for 506122d
  

  kylo5aby

  and

  slaren

  authored
  506122d

  Copy full SHA for 506122d

• CUDA/HIP: fix tests/test-backend-ops (ggerganov#8896)

  JohannesGaessler

  authored
  a8dbc6f

  Copy full SHA for a8dbc6f

• [SYCL] Updated SYCL device filtering (ggerganov#8901)

  Show description for 0478174
  OuadiElfarouki

  authored
  0478174

  Copy full SHA for 0478174

• ggml-backend : fix async copy from CPU (ggerganov#8897)

  Show description for be55695
  slaren

  authored
  be55695

  Copy full SHA for be55695

• make : use C compiler to build metal embed object (ggerganov#8899)

  Show description for 15fa07a
  slaren

  authored
  15fa07a

  Copy full SHA for 15fa07a