Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could not load library cudnn_cnn_infer64_8.dll. Error code 127 #18973

Open
cyclonedll opened this issue Jan 2, 2024 · 5 comments
Open

Could not load library cudnn_cnn_infer64_8.dll. Error code 127 #18973

cyclonedll opened this issue Jan 2, 2024 · 5 comments
Labels
ep:CUDA issues related to the CUDA execution provider platform:windows issues related to the Windows platform

Comments

@cyclonedll
Copy link

Describe the issue

Could not load library cudnn_cnn_infer64_8.dll. Error code 127 when using 1.16.3 CUDA

To reproduce

SessionOptions.MakeSessionOptionWithCudaProvider())

Urgency

No response

Platform

Windows

OS Version

10

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.16.3

ONNX Runtime API

C#

Architecture

X64

Execution Provider

CUDA

Execution Provider Library Version

No response

@github-actions github-actions bot added ep:CUDA issues related to the CUDA execution provider platform:windows issues related to the Windows platform labels Jan 2, 2024
@mszhanyi
Copy link
Contributor

mszhanyi commented Jan 3, 2024

  1. Could you check if cudnn is installed
  2. Could you check if CUPTI is installed
  3. download dependencies to check which dlls are missing?

@cyclonedll
Copy link
Author

The project runs OK with previous version ONNXRuntime before I upgraded .

Then I download cudnn and cuda follow this table:
https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html
微信截图_20240103134214
but it's not work.

Then I found this file in the 'native' directory , so it's should be deployed with OnnxRT , and maybe it's the code issue.

@tianleiwu
Copy link
Contributor

tianleiwu commented Jan 4, 2024

If you install proper cudnn (for CUDA 11) and update PATH environment variable, the DLL shall be able to load unless some dependency is missing.

You might try install latest VC DLLs (x64): https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170#visual-studio-2015-2017-2019-and-2022

@Alwezbluu
Copy link

Hi, have you solved this? I've been searching for reasons for error code 127 for 3 days and none of that works for me :-( literally drives me crazy.

@cyclonedll
Copy link
Author

Hi, have you solved this? I've been searching for reasons for error code 127 for 3 days and none of that works for me :-( literally drives me crazy.

Nope ,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:CUDA issues related to the CUDA execution provider platform:windows issues related to the Windows platform
Projects
None yet
Development

No branches or pull requests

4 participants