Skip to content

Commit

Permalink
Update Llama README
Browse files Browse the repository at this point in the history
  • Loading branch information
natke committed Feb 24, 2024
1 parent 7d74088 commit 0003e58
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/llama/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,8 @@ pip install onnxruntime
Run the model builder script to export, optimize, and quantize the model. More details can be found [here](../../src/python/py/models/README.md)

```bash
cd examples/llama
python -m onnxruntime_genai.models.builder.py -m meta-llama/Llama-2-7b-chat-hf -e cpu -p int4 -o ./model
cd examples/phi2
python -m onnxruntime_genai.models.builder -m meta-llama/Llama-2-7b-chat-hf -e cpu -p int4 -o ./model
```

## Run Llama
Expand Down

0 comments on commit 0003e58

Please sign in to comment.