New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] Update default prefill chunk size of Deepseek #3009

Merged

MasterJH5574 merged 1 commit into mlc-ai:main from tlopex:dp2

Nov 15, 2024

Contributor

tlopex commented Nov 2, 2024

This PR updates the default prefill chunk size from 2048 to 8192 of Deepseek, just the same as other models.


          Update deepseek_model.py

731b1e1

tlopex changed the title ~~[Model] Udpate default prefill chunk size of Deepseek~~ [Model] Update default prefill chunk size of Deepseek

Contributor Author

tlopex commented Nov 15, 2024

cc @MasterJH5574

MasterJH5574 approved these changes

View reviewed changes

MasterJH5574 merged commit 967fb76 into mlc-ai:main

2 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet