Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't find definition of OrtTensorRTProviderOptionsV2 in latest release #21079

Closed
roachsinai opened this issue Jun 18, 2024 · 0 comments
Closed
Labels
ep:TensorRT issues related to TensorRT execution provider

Comments

@roachsinai
Copy link

Describe the issue

I download latest release from https://github.com/microsoft/onnxruntime/releases/download/v1.18.0/onnxruntime-linux-x64-gpu-cuda12-1.18.0.tgz .

image

But found it only support OrtTensorRTProviderOptions, will get above error when define a OrtTensorRTProviderOptionsV2 type variable.

For now I need define a OrtTensorRTProviderOptionsV2 variable to set trt_profile_max_shapes like

tensorrt_options.trt_profile_max_shapes = trt_profile_max_shapes.c_str();
tensorrt_options.trt_profile_opt_shapes = trt_profile_opt_shapes.c_str();
tensorrt_options.trt_cuda_graph_enable = trt_cuda_graph_enable;
session_options.AppendExecutionProvider_TensorRT_V2(tensorrt_options);

How to make it ?

Thanks in advance!

To reproduce

Posted above.

Urgency

I have a strict project pipeline.

Platform

Linux

OS Version

Ubuntu 20.04

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.18.0

ONNX Runtime API

C++

Architecture

X64

Execution Provider

TensorRT

Execution Provider Library Version

No response

@github-actions github-actions bot added the ep:TensorRT issues related to TensorRT execution provider label Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:TensorRT issues related to TensorRT execution provider
Projects
None yet
Development

No branches or pull requests

1 participant