You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Temperature Last is important, since temperature behaves differently before the sampler (like Min-P) vs after. When Temperature Last is enabled, it becomes much easier to find reasonable values and allows a much higher temperature since the tokens have already been trimmed.
Describe the solution you'd like
A clear and concise description of what you want to happen.
Additional context
For API's like tabby, this parameter is labeled temperature_last and is a bool. Aphrodite (either added or added soon) and Ooba also have temperature last with their OAI endpoint API. KCPP, I believe, still uses sampler order, so we can technically have temp last already with KCPP.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Temperature Last is important, since temperature behaves differently before the sampler (like Min-P) vs after. When Temperature Last is enabled, it becomes much easier to find reasonable values and allows a much higher temperature since the tokens have already been trimmed.
Describe the solution you'd like
A clear and concise description of what you want to happen.
Additional context
For API's like tabby, this parameter is labeled
temperature_last
and is a bool. Aphrodite (either added or added soon) and Ooba also have temperature last with their OAI endpoint API. KCPP, I believe, still uses sampler order, so we can technically have temp last already with KCPP.The text was updated successfully, but these errors were encountered: