Skip to content

Commit

Permalink
Add CUDA setup step
Browse files Browse the repository at this point in the history
  • Loading branch information
natke committed May 30, 2024
1 parent e746b04 commit ea10242
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion docs/genai/tutorials/phi3-v.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,12 @@ Support for Windows machines with GPUs other than NVIDIA ones is coming soon!
pip install --pre onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/
```

3. Run the model
3. Setup your CUDA environment

Please follow the steps [here](../howto/setup-cuda-env.md) to setup the CUDA environment.


4. Run the model

Run the model with [phi3v.py](https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3v.py).

Expand Down

0 comments on commit ea10242

Please sign in to comment.