using TensorRT EP by nuget

[alikad]

Describe the issue

Hi
i want to use TensorRT EP but don't know how.
first is i used custom build with windows 10 and vs2019 but i get some errors at building mu project.
now I'm using nuget but i get same errors.
827 unresolved externals errors!

the onnxRuntime config is this:

and the enviroment variable is this:

To reproduce

#include <iostream>
#include <assert.h>
#include <cmath>
#include <stdlib.h>
#include <stdio.h>
#include <vector>
#include "onnxruntime_c_api.h"
#include "cuda_provider_factory.h"
#include "onnxruntime_cxx_api.h"

int main() {
	Ort::Env env(ORT_LOGGING_LEVEL_WARNING, "test");
	Ort::SessionOptions session_options;

#ifdef _WIN32
	const wchar_t* model_path = L"squeezenet.onnx";
#else
	const char* model_path = "squeezenet.onnx";
#endif

	OrtStatus* status = OrtSessionOptionsAppendExecutionProvider_Tensorrt(session_options, 0);
	if (status != nullptr) {
		return -1;
	}
	// Create the session
	Ort::Session session(env, model_path, session_options);

	return 0;
}

Please Help.

Urgency

No response

Platform

Windows

OS Version

10

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.18.1

ONNX Runtime API

C++

Architecture

X64

Execution Provider

TensorRT

Execution Provider Library Version

CUDA 11.8

[tianleiwu]

For 1.18.1, since you use cuda 11.8, you need cuDNN 8.9 and TRT 10.
See https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements. Note that it also applies to TensorRT EP.

If you want to use cuDNN 9, you will need install package for cuda 12: https://onnxruntime.ai/docs/install/#install-onnx-runtime-gpu-cuda-12x-1

[alikad]

thanks, i will test and send the result.

[alikad]

now i added "TensorRT-10.2.0.19.Windows.win10.cuda-11.8", "cudnn-windows-x86_64-8.9.0.131_cuda11", "Microsoft.ML.OnnxRuntime 1.18.1", "Microsoft.ML.OnnxRuntime.Gpu 1.18.1" and cuda 11.8.
but same error.
Code:

error:

includes:

linker libraries:

linker inputs:

@tianleiwu is there any error at my sample code or is it from the libraries?

[tianleiwu]

@alikad,

Could you follow the example code here:
https://github.com/microsoft/onnxruntime-inference-examples/blob/0de2e66e03981714e5308c457b72d785e98d0fe2/c_cxx/squeezenet/main.cpp

[alikad]

with little changes, it worked. i removed the " Ort::ThrowOnError" parts and the final results are achieved
thnks a lot.

[jywu-msft]

issue seems to be resolved. closing.