Skip to content

Commit

Permalink
commit
Browse files Browse the repository at this point in the history
  • Loading branch information
HaruHunab1320 committed Mar 13, 2024
1 parent 4a9a9b2 commit 560d1de
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 1 deletion.
12 changes: 12 additions & 0 deletions litellm/model_prices_and_context_window_backup.json
Original file line number Diff line number Diff line change
Expand Up @@ -2042,6 +2042,18 @@
"litellm_provider": "together_ai",
"mode": "chat"
},
"upstage/SOLAR-0-70b-16bit": {
"input_cost_per_token": 0.0000009,
"output_cost_per_token": 0.0000009,
"litellm_provider": "together_ai",
"mode": "chat"
},
"WizardLM/WizardLM-70B-V1.0": {
"input_cost_per_token": 0.0000009,
"output_cost_per_token": 0.0000009,
"litellm_provider": "together_ai",
"mode": "chat"
},
"ollama/llama2": {
"max_tokens": 4096,
"input_cost_per_token": 0.0,
Expand Down
2 changes: 1 addition & 1 deletion litellm/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -3583,7 +3583,7 @@ def cost_per_token(
model_cost_ref = litellm.model_cost
model_with_provider = model
if custom_llm_provider is not None:
model_with_provider = custom_llm_provider + "/" + model
model_with_provider = model
if region_name is not None:
model_with_provider_and_region = (
f"{custom_llm_provider}/{region_name}/{model}"
Expand Down

0 comments on commit 560d1de

Please sign in to comment.