Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ExLlama inference support #4

Open
Glavin001 opened this issue Jul 9, 2023 · 1 comment
Open

Add ExLlama inference support #4

Glavin001 opened this issue Jul 9, 2023 · 1 comment
Assignees
@Glavin001
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed testing
Milestone
Startup Interview...

Comments

@Glavin001
Copy link
Owner

Glavin001 commented Jul 9, 2023 •
edited
Loading

@Glavin001 Glavin001 added enhancement New feature or request help wanted Extra attention is needed good first issue Good for newcomers testing labels Jul 9, 2023
@Glavin001 Glavin001 moved this to In Progress in Startup Interviews LLM Jul 9, 2023
@Glavin001 Glavin001 self-assigned this Jul 9, 2023
@Glavin001 Glavin001 moved this from In Progress to Todo in Startup Interviews LLM Jul 9, 2023
@Glavin001
Copy link
Owner Author

Glavin001 commented Jul 11, 2023 •
edited
Loading

Use https://github.com/hommayushi3/exllama-runpod-serverless by @hommayushi3 🎉

@Glavin001 Glavin001 mentioned this issue Jul 11, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Glavin001 Glavin001

Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed testing
Projects
Startup Interviews LLM
Status: Todo
Milestone
Startup Interviews LLM - v0.1.0
Development

No branches or pull requests
1 participant
@Glavin001