Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
erik-dunteman authored Mar 10, 2024
1 parent 3ea5de5 commit bad4e12
Showing 1 changed file with 2 additions and 5 deletions.
7 changes: 2 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,7 @@ ai = Fructose(model = "gpt-3.5-turbo")



## Custom Clients
## Custom Clients and Alternative APIs
You can configure your own OpenAI client and use it with Fructose.
This allows you to do things like route your calls through proxies or OpenAI-compatible LLM APIs.

Expand All @@ -151,10 +151,7 @@ client = OpenAI(
ai = Fructose(client = client)
```

### Alternative LLM APIs:
Note that Fructose uses OpenAI's `json` return mode for all calls, and `tools` API for the `uses` function-calling.

Not all alternative LLM providers support these features, and those that do likely exhibit subtle differences in the API.
Note that Fructose uses OpenAI's `json` return mode for all calls, and `tools` API for the `uses` function-calling. Not all alternative LLM providers support these features, and those that do likely exhibit subtle differences in the API.

You're free to point to alternative APIs using a custom client (above) or the `OPENAI_BASE_URL` environment variable, but Fructose does not officially support it.

Expand Down

0 comments on commit bad4e12

Please sign in to comment.