Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I specify the rope scaling type when starting the API server? #2768

Open
snachx opened this issue Nov 18, 2024 · 1 comment
Open
Assignees

Comments

@snachx
Copy link

snachx commented Nov 18, 2024

I noticed that version 0.6.3 already supports yarn, but there doesn’t seem to be a parameter to specify the rope scaling type when starting with lmdeploy serve api_server.

@snachx snachx changed the title [Docs] How can I specify the rope scaling type when starting the API server? How can I specify the rope scaling type when starting the API server? Nov 18, 2024
@lvhan028
Copy link
Collaborator

we haven't released the api for setting rope scaling type yet.
It will be our honor if you'd like to pull an request to support this feature.

@lvhan028 lvhan028 self-assigned this Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants