Skip to content

Commit

Permalink
Update kobold_v2.py
Browse files Browse the repository at this point in the history
Adjust max context from 32000 to 32768 (proper base 2 value)
  • Loading branch information
Pyroserenus authored Nov 25, 2024
1 parent 4ec3f7b commit 02a376d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion horde/apis/models/kobold_v2.py
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ def __init__(self, api):
"max_context_length": fields.Integer(
min=80,
default=1024,
max=32000,
max=32768,
description="Maximum number of tokens to send to the model.",
),
"max_length": fields.Integer(
Expand Down

0 comments on commit 02a376d

Please sign in to comment.