Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Support AVX-512 for Intel Rocket Lake #628

Open
4 tasks done
aluklon opened this issue Nov 14, 2024 · 0 comments
Open
4 tasks done

Feature Request: Support AVX-512 for Intel Rocket Lake #628

aluklon opened this issue Nov 14, 2024 · 0 comments

Comments

@aluklon
Copy link

aluklon commented Nov 14, 2024

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

I have Intel i9-11900 (Rocket Lake) and i5-12600 (Alder Lake) CPUs. Llamafile runs twice as slow on "Rocket Lake" as "Alder Lake". Although "Rocket Lake" supports AVX-512. I suspect this is because "Rocket Lake" uses AVX2 instead of AVX-512. Is it possible to support AVX-512 for "Rocket Lake"?

lscpu-11900.txt
lscpu-12600.txt

llamafile-bench-11900.json
llamafile-bench-12600.json

Motivation

This feature will increase the performance of Llamafile for "Rocket Lake".

Possible Implementation

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant