You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
I have Intel i9-11900 (Rocket Lake) and i5-12600 (Alder Lake) CPUs. Llamafile runs twice as slow on "Rocket Lake" as "Alder Lake". Although "Rocket Lake" supports AVX-512. I suspect this is because "Rocket Lake" uses AVX2 instead of AVX-512. Is it possible to support AVX-512 for "Rocket Lake"?
Prerequisites
Feature Description
I have Intel i9-11900 (Rocket Lake) and i5-12600 (Alder Lake) CPUs. Llamafile runs twice as slow on "Rocket Lake" as "Alder Lake". Although "Rocket Lake" supports AVX-512. I suspect this is because "Rocket Lake" uses AVX2 instead of AVX-512. Is it possible to support AVX-512 for "Rocket Lake"?
lscpu-11900.txt
lscpu-12600.txt
llamafile-bench-11900.json
llamafile-bench-12600.json
Motivation
This feature will increase the performance of Llamafile for "Rocket Lake".
Possible Implementation
No response
The text was updated successfully, but these errors were encountered: