Skip to content

Issues: ztxz16/fastllm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

230 Open 137 Closed
230 Open 137 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Main.exe compiled with w64devkit v.1.21.0 silently terminates after launching.
#499 opened Dec 13, 2024 by JohnClaw
Thanks for great llm inference engine. Could you make a dll version of it, please?
#498 opened Dec 13, 2024 by JohnClaw
如何配置参数使服务处理请求并发数最大化
#494 opened Oct 21, 2024 by xiaoshizijiayou
error: no suitable user-defined conversion from "__half" to "__nv_bfloat16" exists
#493 opened Oct 9, 2024 by xiaoshizijiayou
如何通过参数方式直接加载adapter?
#491 opened Sep 26, 2024 by xiaoshizijiayou
28
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xce in position 4411: invalid continuation byte
#489 opened Sep 19, 2024 by huqiangDu
加速llama3-sqlcoder-8b (Finetuned from model: [Meta-Llama-3-8B-Instruct])模型时，输出内容错误，全部是"!!!!!"
#487 opened Sep 15, 2024 by Juvember
1
模型权重转化之后和原来的模型回答的内容不一致
#486 opened Sep 11, 2024 by Whylickspittle
1
chatglm 失去 function calling 能力
#485 opened Aug 16, 2024 by NingRiCheng
请问一下国产显卡Ascend 910 and Hygon DCU如何安装fastllm？
#482 opened Jul 30, 2024 by cgq0816
1
GLM4-V-9B什么时候会出部署代码呢？
#481 opened Jul 29, 2024 by GalSang17
如何多卡部署
#480 opened Jul 22, 2024 by longcheng183
1
OSError: libcublas.so.ll: cannot open shared odject file: No such file or directory
#471 opened Jun 28, 2024 by lichengyang666
1
Meta-Llama-3-70B-Instruct
#470 opened Jun 26, 2024 by longcheng183
5
qwen1.5 int4模型回复出现解码问题：UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 72-73: invalid continuation byte
#461 opened Jun 5, 2024 by zhang415
make -j过程中报错
#459 opened Jun 4, 2024 by AIlaowong
3
[CMakeFiles/Makefile2:100: CMakeFiles/pyfastllm.dir/all]
#454 opened May 9, 2024 by ttaop
结果返回一直是<unk>
#452 opened May 8, 2024 by VincentLore
3
chatglm3 相同提示词生成结果一致
#450 opened Apr 29, 2024 by ttaop
Do you have a plan to implement the CudaCatOp?
#448 opened Apr 25, 2024 by dp-aixball
千问qwen1.5-14B-chat解码错误
#446 opened Apr 23, 2024 by yiguanxian
2
cmake -j报错
#445 opened Apr 23, 2024 by gggdroa
2
无法安装fastllm_pytools
#443 opened Apr 12, 2024 by bailingchun
1
流式输出中断问题
#440 opened Mar 25, 2024 by lwinhong
模型转换的时候是不是不能用量化过的模型
#437 opened Mar 17, 2024 by shum-elli
1
ProTip! no:milestone will show everything without a milestone.