Support for tokenizer.chat_template from GGUF metadata? #2091
Unanswered
bioshazard
asked this question in
Q&A
Replies: 1 comment
-
|
I should mention for this specific model, I am aware of and appreciate you providing a ready made YAML https://github.com/mudler/LocalAI/blob/master/embedded/models/llama3-instruct.yaml |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Do you have or plan support for detecting and using the chat template provided in the GGUF metadata to automate new model onboarding?
Beta Was this translation helpful? Give feedback.
All reactions