Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

trtexec works, onnxruntime failed to load #19180

Open
HuaHua-Xiao opened this issue Jan 17, 2024 · 2 comments
Open

trtexec works, onnxruntime failed to load #19180

HuaHua-Xiao opened this issue Jan 17, 2024 · 2 comments
Assignees
Labels
ep:TensorRT issues related to TensorRT execution provider

Comments

@HuaHua-Xiao
Copy link

Describe the issue

I can run trtexec fine, but loading trtexec's pre-built engine with ONNX Runtime gives me an error. How can I solve this? Thank you!
log

To reproduce

mask2former model

Urgency

No response

Platform

Linux

OS Version

Ubuntu 20.04.6 LTS

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

onnxruntime-linux-x64-gpu-1.16.3.tgz

ONNX Runtime API

C++

Architecture

X86

Execution Provider

TensorRT

Execution Provider Library Version

TensorRT-8.6.1.6 cuda_11.7 NVIDIA-SMI 460.39 Driver Version: 460.39 Tesla V100

@github-actions github-actions bot added the ep:TensorRT issues related to TensorRT execution provider label Jan 17, 2024
@chilo-ms
Copy link
Contributor

Could you share the whole log with us? that helps us debug.
Also, if possible, could you share the pre-built engine?

@HuaHua-Xiao
Copy link
Author

Could you share the whole log with us? that helps us debug. Also, if possible, could you share the pre-built engine?

Thank you. Can you e-mail me? The file is too big.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:TensorRT issues related to TensorRT execution provider
Projects
None yet
Development

No branches or pull requests

2 participants