Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failing to find trt_timing_cache_path #21484

Open
darthmalak1986 opened this issue Jul 24, 2024 · 4 comments
Open

failing to find trt_timing_cache_path #21484

darthmalak1986 opened this issue Jul 24, 2024 · 4 comments
Labels
ep:TensorRT issues related to TensorRT execution provider stale issues that have not been addressed in a while; categorized by a bot

Comments

@darthmalak1986
Copy link

hello im trying to use tensorrt and when looking for the trt path cache, while processing.

is giving me this error

Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:709 onnxruntime::python::CreateExecutionProviderInstance Invalid TensorRT EP option: trt_timing_cache_path
when using [('TensorrtExecutionProvider', {'trt_engine_cache_enable': True, 'trt_engine_cache_path': 'tensorrt-engines', 'trt_timing_cache_enable': True, 'trt_timing_cache_path': 'tensorrt-engines', 'trt_dump_ep_context_model': True, 'trt_ep_context_file_path': 'tensorrt-engines', 'trt_layer_norm_fp32_fallback': True, 'trt_builder_optimization_level': 5}), 'CUDAExecutionProvider', 'CPUExecutionProvider']
Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.

it seems to be or that i put the wrong path or maybe i just miss typed something

can someone help me a bit please'??

@github-actions github-actions bot added the ep:TensorRT issues related to TensorRT execution provider label Jul 24, 2024
@chilo-ms
Copy link
Contributor

chilo-ms commented Jul 24, 2024

Which ORT version you were using?
Simply from what you pasted above seems okay, but it's better if you provide the python code to help us repro the issue.

@darthmalak1986
Copy link
Author

darthmalak1986 commented Jul 24, 2024

Which ORT version you were using? Simply from what you pasted above seems okay, but it's better if you provide the python code to help us repro the issue.

idk how to check that, i only followed a guide.

if you can guide me trough it, for sure i will provide the information your requesting, for my understaing regarding the issue the "trt_cache_path" is or not specified or wrong typed.

And thats part of the configuration of onnxruntime, is what copilot said xD

but i dont know how to fix that i have been looking for a configuration file but i cant find any. So bcoz the path is not specified (probably) bcoz i only copy and paste files tensorrt is failing so is using cude - cpu

for sure the path is wrong if i could know what file is maybe i could fix it or just replace it, probably if i do will screw something else. So i rather leave it the way it is and just edit or fix what is requesting.

@darthmalak1986
Copy link
Author

darthmalak1986 commented Jul 24, 2024

Captura de pantalla (458)
Captura de pantalla (459)
Captura de pantalla (460)

Copy link
Contributor

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label Aug 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:TensorRT issues related to TensorRT execution provider stale issues that have not been addressed in a while; categorized by a bot
Projects
None yet
Development

No branches or pull requests

2 participants