Has anyone gotten TensorRT working on a windows install? #1042
-
I have been trying this all day and can't seem to figure it out. The sample apps in my TensorRT folder (including the Onnx_mnist) one successfully build in Visual Studio, but when I load Roop Unleashed it is always defaulting to the CPU. The only error messaging i see in the load up is 'INFO: Could not find files for the given pattern(s)' but I'm not sure to figure out where in the script it is breaking to find my error. I assume I have a pathing issue, but the only thing i can find only is to add an environment variable for the library for TensorRT, which i did. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
You're not doing anything wrong, TensorRT just isn't supported so far 😄 |
Beta Was this translation helpful? Give feedback.
You're not doing anything wrong, TensorRT just isn't supported so far 😄
Quick explanation:
Some time ago when NVIDIA started with TensorRT it was more or less a media stunt. The way it works, is precalculating repeated calculations and caching the results. This works pretty good for stuff like Transformers (think Stable Diffusion etc.) but less good for dynamic calculations like face swapping. It changed a bit lately and might be incorporated soon. One of these days when I'm bored with too much time on my hands I'll implement it but don't expect faster results.