Questions about CUda Cudnn issues.

[Skettalee]

Is there any way to use cuda 12.1 instead of the 11.8 version as I have upgraded to 12.1 for use with all of my other tools like comfyui, facefusion, foooocus, automatic1111 and others and I have been trying for 2 days to figure out a way to use my current cuda setup with troop-unleashed but i have failed too many times with no luck. I keep getting this error as soon as i import the face photo:
`Number of CUDA devices: 1 Currently used Id: 0 Device Name: NVIDIA GeForce RTX 4070
Using provider [('CUDAExecutionProvider', {'device_id': 0})] - Device:cuda
Running on local URL: http://127.0.0.1:7860
INFO:httpx:HTTP Request: GET http://127.0.0.1:7860/startup-events "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: HEAD http://127.0.0.1:7860/ "HTTP/1.1 200 OK"

To create a public link, set share=True in launch().
2024-09-04 17:01:29.9145403 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\Sd\roop-unleashed\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: G:\Sd\roop-unleashed\models\buffalo_l\1k3d68.onnx landmark_3d_68 ['None', 3, 192, 192] 0.0 1.0
2024-09-04 17:01:30.4315609 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\Sd\roop-unleashed\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: G:\Sd\roop-unleashed\models\buffalo_l\2d106det.onnx landmark_2d_106 ['None', 3, 192, 192] 0.0 1.0
2024-09-04 17:01:30.5321317 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\Sd\roop-unleashed\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: G:\Sd\roop-unleashed\models\buffalo_l\det_10g.onnx detection [1, 3, '?', '?'] 127.5 128.0
2024-09-04 17:01:30.6287146 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\Sd\roop-unleashed\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: G:\Sd\roop-unleashed\models\buffalo_l\genderage.onnx genderage ['None', 3, 96, 96] 0.0 1.0
2024-09-04 17:01:31.0908003 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "G:\Sd\roop-unleashed\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: G:\Sd\roop-unleashed\models\buffalo_l\w600k_r50.onnx recognition ['None', 3, 112, 112] 127.5 127.5
set det-size: (640, 640)`

And it sometimes does work but only uses the CPU which is near hours slower than my GPU can do. I have also been trying to figure out how i can have both cuda 11.8 and 12.1 installed but wihout any good results so far.

[C0untFloyd]

I feel your pain. I'm also using ComfyUI and SD, however they are still running on 11.8 and I left it at that so far.
Running multiple cuda versions is tricky. Technically one could write 2 batchfiles to switch between them forth and back (removing one version from the PATH, adding the other one). This of course isn't something you want to do every time when starting some app. For Ubuntu I've found this: https://gist.github.com/garg-aayush/156ec6ddda3d62e2c0ddad00b7e66956
Anyway, sooner or later I will be forced to switch to the current cuda too but I'm already afraid of the error issues from newbie users 🥲