DLL load failed while importing exllamav2_ext

[jagerius]

Hi,
I'm trying to run this replacing ooba, but it constantly complains about missing exlllamav2, even though I'm installing it thorugh "pip install exllamav2-0.0.15+cu118-cp310-cp310-win_amd64.whl". I'm using python 3.10 and CUDA 1.18 - what is the problem here? I'm using Windows 10.

If someone could drop a step by step windows installation ,I would be grateful.

[turboderp]

What version of Torch do you have installed?

[dicksondickson]

I'm having the same issue. I'm running Torch nightly (2.4.0.dev20240421+cu121)

EDIT
Uninstalled torch nightly and installed stable torch 2.3. It is working now.
Thank you for all your amazing work! @turboderp