-
Notifications
You must be signed in to change notification settings - Fork 138
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEATURE] Support local cross-encoder model #1589
Comments
Gonna implement this as a new ml-algorithm / function name: |
A bunch of requests have come in for remote reranking models too, so I'll make sure that connectors can deal with TextSimilarityDatasets appropriately as well |
Make sure local model and remote model can be switched smoothly . |
This is done in this PR #1954 |
@HenryL27 will check remote model and then we can close this issue. |
Is your feature request related to a problem?
We're trying to put a bunch of local model types in ml-commons (#1164). One such type is a cross-encoder. This will allow us to support reranking in the neural-search plugin, which a lot of people have asked for.
What solution would you like?
Will be able to upload a custom cross-encoder model, deploy it, and use it with the upcoming neural search reranking processor.
What alternatives have you considered?
External hosting: Still would have to deal with the inputs and outputs, and then we also get the pleasure of figuring out some solution for externally hosting cross-encoders.
LTR: That can do reranking, but not cross-encoder reranking, so this isn't where that thought belongs.
Do you have any additional context?
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: