Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add model limitation to connector #1390

Open
ylwu-amzn opened this issue Sep 27, 2023 · 0 comments
Open

[FEATURE] Add model limitation to connector #1390

ylwu-amzn opened this issue Sep 27, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request Priority-Medium

Comments

@ylwu-amzn
Copy link
Collaborator

Model has its own limitation. For example LLM generall have a upper limit of token number; multi-modal model may have limitation on image size.

One option is we can add limitation to connector. So user can define what's the limit of the model. Sometimes the limit could be a business decision for example a model can accept big image with size 50MB, but user may consider that's too much for their use case, they may prefer to define the limit as 1MB.

@ylwu-amzn ylwu-amzn added enhancement New feature or request untriaged labels Sep 27, 2023
@ylwu-amzn ylwu-amzn moved this to Untriaged in ml-commons projects Oct 20, 2023
@b4sjoo b4sjoo moved this from Untriaged to Backlog in ml-commons projects Jan 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Priority-Medium
Projects
Status: Backlog
Development

No branches or pull requests

3 participants