Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add llama3 support #2

Open
jrojer opened this issue May 18, 2024 · 2 comments
Open

add llama3 support #2

jrojer opened this issue May 18, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@jrojer
Copy link
Owner

jrojer commented May 18, 2024

No description provided.

@jrojer
Copy link
Owner Author

jrojer commented May 23, 2024

llama3 test launch showed 400 Bad Request

@jrojer
Copy link
Owner Author

jrojer commented May 29, 2024

it seems that openai compatible llama3 API does not support system prompt as chat API item. The system prompt should be handled in legacy gpt-3 style

@jrojer jrojer changed the title add non openai (but openai compatible api) support add llama3 support May 29, 2024
@jrojer jrojer added the enhancement New feature or request label Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jrojer