New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] SGlang, the fast serving framework #898

Open

skmanzg opened this issue Oct 28, 2024 · 1 comment

Assignees

Labels

enhancement New Module

Contributor

skmanzg commented Oct 28, 2024

Is your feature request related to a problem? Please describe.

This is kind of an 'FYI' for @vkehfdl1 from our previous brief coffee chat. You may simply close this issue if you are already fully aware of it.

Additional context

You may refer the sources below:

the official GitHub repo
reactions, reviews from the Korean community

skmanzg added the enhancement label

vkehfdl1 self-assigned this

vkehfdl1 added the New Module label

Contributor

vkehfdl1 commented Oct 28, 2024

@skmanzg
Thanks:)
It is weird I cannot find sglang llama index integration.
We will implement it soon.

Thanks:)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment