New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] Update default prefill chunk size of Deepseek #3009

Open

tlopex wants to merge 1 commit into mlc-ai:main from tlopex:dp2

Contributor

tlopex commented Nov 2, 2024

This PR updates the default prefill chunk size from 2048 to 8192 of Deepseek, just the same as other models.


          Update deepseek_model.py

731b1e1

tlopex changed the title ~~[Model] Udpate default prefill chunk size of Deepseek~~ [Model] Update default prefill chunk size of Deepseek

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet