New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does support GPU inference ? #346

Open

shatealaboxiaowang opened this issue Sep 18, 2024 · 1 comment

shatealaboxiaowang commented Sep 18, 2024

Hi, dear：

Thanks for your open source.i try to run colbert2.0 on cuda,but error. so, can it specific gpu device to run model ?

Looking forward your replay.

Member

joein commented Sep 23, 2024

Hi, yes, you can run fastembed models on gpu
Have you seen this example ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment