Drop your model suggestions/ones you've tried. #781
testercell
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
If you stop by please drop a model_ID and Model_basename that you have found to be useful.
Thus far I have had trouble with specific models that I wanted to try and the best one i have found thus far is
MODEL_ID = "TheBloke/Mistral-7B-Instruct-v0.1-GGUF"
MODEL_BASENAME = "mistral-7b-instruct-v0.1.Q8_0.gguf"
I'm looking for bigger and better models to try but am having trouble getting any of them to load.
Beta Was this translation helpful? Give feedback.
All reactions