Skip to content

Commit

Permalink
Update openai.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mgoin authored Oct 30, 2023
1 parent fd447cf commit befb69c
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions src/deepsparse/server/openai.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,6 @@ Similar to the Deepsparse server (see `README.md` for details), a config file ca
created for the text generation models. A sample config is provided below

```yaml
num_cores: 2
num_workers: 2
endpoints:
- task: text_generation
model: zoo:opt-1.3b-opt_pretrain-pruned50_quantW8A8
Expand Down Expand Up @@ -36,7 +34,7 @@ or through the OpenAI API.

### OpenAI API Requests

- Starting the server with the config above, we have accesso to one model
- Starting the server with the config above, we have access to one model
`zoo:opt-1.3b-opt_pretrain-pruned50_quantW8A8`. We can send an inference request using
the OpenAI API, as shown in the example code below:

Expand Down Expand Up @@ -99,4 +97,4 @@ obj = {
response = requests.post(url, json=obj)
print(response.text)
```
```

0 comments on commit befb69c

Please sign in to comment.