Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Add Model" is not adding models to the model list. #9255

Open
5 tasks done
taowang1993 opened this issue Oct 11, 2024 · 1 comment
Open
5 tasks done

"Add Model" is not adding models to the model list. #9255

taowang1993 opened this issue Oct 11, 2024 · 1 comment
Labels
🐞 bug Something isn't working

Comments

@taowang1993
Copy link

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.9.1

Cloud or Self Hosted

Cloud, Self Hosted (Docker)

Steps to reproduce

The "Add Model" feature does not work.

I tried many many times.

I expect it will add a custom model to the model list, but it doesn't.

image

The docs says predefined-model + customizable-model can coexist.

Does that mean I need to use the same base url and api key for predefined and custom?

https://docs.dify.ai/guides/model-configuration/new-provider

The reason I ask is that using different base url and api key don't seem to work.

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

Copy link

dosubot bot commented Oct 11, 2024

It seems like you're encountering an issue with adding a custom model in Dify. Here are some relevant points and solutions that might help:

  1. Predefined vs. Custom Models: For predefined models, you only need unified provider credentials (a single API key and base URL). For custom models, you need to configure credentials for each model, which may require different API keys or URLs. They can coexist, but they don't need to share the same base URL and API key [1][2].

  2. Steps to Add a Custom Model:

    • Create a provider YAML file according to the Provider Schema.
    • Implement the provider code and add model type modules.
    • Write and run test code to ensure everything is configured correctly [1].
  3. Similar Issues: There was a similar issue where users had trouble with model configuration. The solution involved ensuring correct proxy configuration and API base URL updates [3].

Make sure your configurations align with these guidelines, and check if there are any errors in your setup. If the problem persists, reviewing the proxy settings and API base URL might help.

To continue talking to Dosu, mention @dosu.

@dosubot dosubot bot added the 🐞 bug Something isn't working label Oct 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐞 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant