InfiniFlow
Increase max token output #1886
WayneSimpson
started this conversation in
General
Replies: 1 comment
-
|
OK. We're gona increase it. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Increate max token output, currently this is set at 2048, some model can output way more, can we increase this value and have some kind of auto continue?
Beta Was this translation helpful? Give feedback.
All reactions