[Feature Request] Making the cuda version explicit in the python package name #19438
Labels
ep:CUDA
issues related to the CUDA execution provider
feature request
request for unsupported feature or enhancement
release:1.17.0
Describe the feature request
Onnxruntime-gpu packages can support either CUDA 11 or CUDA 12
As described in the documentation here one needs to choose different
python packages index urls to choose which version of CUDA is supported.
Given a version number we do not know which CUDA version is supported unless we know what package index url was used to do the install, which does not seems ideal in term of handling python dependencies in complex engineering systems. This is for example making thing very complicated when using a private python package repository with a mechanism that caches wheels from upstream feeds. In this case we cannot have both packages (the one for cuda11 and cuda12) in the cache because they have the same name.
In comparison CuPy uses package naming convention where the CUDA version is explicitly as part of the package name (cupy-cuda12x, cupy-cuda11x). This make things much more convenient.
Could potentially the same be done for
onnxtuneime-gpu
i.e. could we use packages namesonnxtuneime-gpu-cuda11x
andonnxtuneime-gpu-cuda12x
and have both on pypi.org ?Or is the plan to stop supporting cuda11 altogether in future onnxruntime-gpu releases?
Describe scenario use case
Caching onnxruntime-gpu wheels with cuda 11 and cuda 11 in a private packages feed.
The text was updated successfully, but these errors were encountered: