New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeError: AsyncEngineArgs.init() got an unexpected keyword argument 'engine_use_ray' #573

Open

1 of 2 tasks

liuliwei91 opened this issue Sep 27, 2024 · 1 comment

Assignees

liuliwei91 commented Sep 27, 2024

System Info / 系統信息

TypeError: AsyncEngineArgs.init() got an unexpected keyword argument 'engine_use_ray'

Who can help? / 谁可以帮助到您？

No response

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

python openai_api_server.py

Expected behavior / 期待表现

python openai_api_server.py

zRzRzRzRzRzRzR self-assigned this

Member

zRzRzRzRzRzRzR commented Sep 29, 2024 •

edited

Loading

我们注意到了，现在先暂时移除这个参数。我们之后会改代码，vllm更新导致的这个参数好像没有了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment