From ea102422eb14bd46e6f6ec947e1ecf7b97c177ab Mon Sep 17 00:00:00 2001 From: natke Date: Thu, 30 May 2024 16:14:21 -0700 Subject: [PATCH] Add CUDA setup step --- docs/genai/tutorials/phi3-v.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/docs/genai/tutorials/phi3-v.md b/docs/genai/tutorials/phi3-v.md index 07255b899622b..b4242b0b5fbe6 100644 --- a/docs/genai/tutorials/phi3-v.md +++ b/docs/genai/tutorials/phi3-v.md @@ -68,7 +68,12 @@ Support for Windows machines with GPUs other than NVIDIA ones is coming soon! pip install --pre onnxruntime-genai-cuda --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/ ``` -3. Run the model +3. Setup your CUDA environment + + Please follow the steps [here](../howto/setup-cuda-env.md) to setup the CUDA environment. + + +4. Run the model Run the model with [phi3v.py](https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi3v.py).