[Feature Request] Is there any way to use OpenVINO EP and TensorRT EP in the same environment?

[jinluyang]

Describe the feature request

I'm using python, I know if I want to use TensorRT EP, I have to use onnxruntime-gpu. If I want to use OPENVINO I have to use onnxruntime-openvino. But These cannot be installed in the same docker container. They overlap each other. I want to use both while don't want to build from source.

Describe scenario use case

We use both CPU and GPU for inference of a model. And we want to use a single docker image.

[tianleiwu]

Try two virtual python environments (like conda or venv).

[jywu-msft]

sorry, currently you would need to build this configuration from source. we are investigating how to support dynamic loading of EP libraries. But this will take time as it requires implementing and migrating to new interfaces.
using multiple python environment as @tianleiwu suggested is a possible workaround.