New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

结果返回一直是<unk> #452

Open

VincentLore opened this issue May 8, 2024 · 3 comments

VincentLore commented May 8, 2024

显卡为4090，系统Ubuntu 22.04
驱动和CUDA
Driver Version: 550.54.15 CUDA Version: 12.4 python 3.10
尝试用chatglm2、chatglm3、qwen1.5均只能输出

Author

VincentLore commented May 8, 2024

Juvember commented Sep 17, 2024

你好，我也遇到了相同的问题，请问你解决这个问题了吗

Author

VincentLore commented Sep 18, 2024

你好，我也遇到了相同的问题，请问你解决这个问题了吗

没有，换其他推理框架了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment