Skip to content

Commit

Permalink
Update phi-3-tutorial.md
Browse files Browse the repository at this point in the history
  • Loading branch information
natke authored Apr 23, 2024
1 parent e7fb92b commit 5956c45
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions examples/python/phi-3-tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -130,9 +130,11 @@ pip install *.whl

Run the model with [this script](https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/model-qa.py).


The script accepts a model folder and takes the generation parameters from the config in that model folder. You can also override the parameters on the command line.

```bash
pip install numpy
python model-qa.py -m models/phi3-mini-4k-instruct-cpu-int4-rtn-block-32
```

Expand Down

0 comments on commit 5956c45

Please sign in to comment.