From 82e2da0819dfa7dc67434ccb073fed8dc911d21c Mon Sep 17 00:00:00 2001 From: Sophie Schoenmeyer <107952697+sophies927@users.noreply.github.com> Date: Tue, 23 Apr 2024 14:32:17 -0700 Subject: [PATCH] Update with-python.md with CUDA 12.X instructions (#20442) ### Description with-python.md does not currently include installation instructions for CUDA 12.X, so I added the instructions from https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements. ### Motivation and Context --- docs/get-started/with-python.md | 18 ++++++++++++++++-- 1 file changed, 16 insertions(+), 2 deletions(-) diff --git a/docs/get-started/with-python.md b/docs/get-started/with-python.md index 399fd6014f831..c230af0c2dab0 100644 --- a/docs/get-started/with-python.md +++ b/docs/get-started/with-python.md @@ -20,14 +20,28 @@ Below is a quick guide to get the packages installed to use ONNX for model seria There are two Python packages for ONNX Runtime. Only one of these packages should be installed at a time in any one environment. The GPU package encompasses most of the CPU functionality. +### Install ONNX Runtime CPU + +Use the CPU package if you are running on Arm CPUs and/or macOS. + +```bash +pip install onnxruntime +``` + +### Install ONNX Runtime GPU (CUDA 11.x) + +The default CUDA version for ORT is 11.8. + ```bash pip install onnxruntime-gpu ``` -Use the CPU package if you are running on Arm CPUs and/or macOS. +### Install ONNX Runtime GPU (CUDA 12.x) + +For Cuda 12.x, please use the following instructions to install from [ORT Azure Devops Feed](https://aiinfra.visualstudio.com/PublicPackages/_artifacts/feed/onnxruntime-cuda-12/PyPI/onnxruntime-gpu/overview) ```bash -pip install onnxruntime +pip install onnxruntime-gpu --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/ ``` ## Install ONNX for model export