-
Notifications
You must be signed in to change notification settings - Fork 37
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow to set the base_url for the openai gateway #60
Comments
@shuther thanks for opening this issue. Sorry for the slow response. Do you have any interest in creating a PR for this functionality? I think it would be great to support local models and additional providers. |
@keiththomps did you have any luck with this? It looks like you added the ability to specify a base url, did that work for you? I really appreciate your contribution. |
@ferrislucas I honestly can't remember 😅 I ended up dabbling with anthropic and spun up a completely different tool heavily inspired by promptr to do that. Let me pull my branch down and test it out with our proxy |
Tested it using my work gateway and it works 👍 #64 Sorry for not adding a test. |
Thank you very much for the PR and your time @keiththomps ! |
Add the ability to change the openai endpoint (baseURL) as per OpenAI SDK to be able to leverage self hosted LLM.
The text was updated successfully, but these errors were encountered: