Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Documentation] Latest Supported Onnx Runtime for TensorRT mentioned as 12.2 #19399

Closed
Samiii777 opened this issue Feb 3, 2024 · 2 comments
Closed
Labels
documentation improvements or additions to documentation; typically submitted using template

Comments

@Samiii777
Copy link

Describe the documentation issue

Not sure if I am correct or not, but I realized onnx runtime for tensorrt recently has been added for CUDA 12.2 in here:
docs/execution-providers/TensorRT-ExecutionProvider.md
https://github.com/microsoft/onnxruntime/blob/gh-pages/docs/execution-providers/CUDA-ExecutionProvider.md#requirements

according to Nvidia's documentation TensorRT 8.6 GA is only supported by CUDA 12.1 and not 12.2
https://developer.nvidia.com/nvidia-tensorrt-8x-download
am I missing something ?

Page / URL

https://github.com/microsoft/onnxruntime/blob/gh-pages/docs/execution-providers/CUDA-ExecutionProvider.md#requirements

@Samiii777 Samiii777 added the documentation improvements or additions to documentation; typically submitted using template label Feb 3, 2024
@tianleiwu
Copy link
Contributor

tianleiwu commented Feb 4, 2024

Because of CUDA Minor Version Compatibility, Onnx Runtime built with CUDA 12.2 shall be compatible with CUDA 12.1 and 12.3.

For example, Nvidia docker nvcr.io/nvidia/pytorch:24.01-py3 has CUDA 12.3 and TRT 8.6 GA. They work well with Onnx Runtime 1.17 in my tests.

@Samiii777
Copy link
Author

thanks for clarifying

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation improvements or additions to documentation; typically submitted using template
Projects
None yet
Development

No branches or pull requests

2 participants