Tabby cannot find libcudart.so.12

[martinellison]

I've installed tabby under Linux, but when I try to start Tabby, I just the following error repeated endlessly:

./tabby serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda
2024-12-13T12:35:52.864759Z  WARN llama_cpp_server::supervisor: crates/llama-cpp-server/src/supervisor.rs:110: <embedding>: /work/tabby/llama-server: error while loading shared libraries: libcudart.so.12: cannot open shared object file: No such file or directory

Context is Fedora 41. I have cuda-opencl-12-2 installed.

[wsxiaoys]

Please check https://docs.nvidia.com/cuda/cuda-installation-guide-linux/, Tabby does not work with the xorg-x11-drv-nvidia-cuda series of RPMs.

[martinellison]

Tabby does not work with the xorg-x11-drv-nvidia-cuda series of RPMs.