Add ml inference ingest processor documentation #7095
Conversation
mingshl
requested review from
hdhalter,
kolchfa-aws,
Naarcha-AWS,
vagimeli,
AMoo-Miki,
natebower,
dlvenable,
stephen-crawford and
epugh
as code owners
Signed-off-by: Mingshi Liu <[email protected]>
|
Thanks so much, @mingshl! Do you need a tech review or is it ready for doc review? In the meantime, can you please see if you can address some of the Vale style errors? |
hdhalter
added
3 - Tech review
|
|
||
| **Step 1: Create a pipeline.** | ||
|
|
||
| The following example request creates an ingest pipeline where the model requires an `input` field and produces a `data` field in the prediction task and the document has a `passage_text` field, which will be converted into text embeddings and the embeddings will be stored in `passage_embedding` field. |
There was a problem hiding this comment.
Suggest create a model with one of our blueprints https://github.com/opensearch-project/ml-commons/tree/2.x/docs/remote_inference_blueprints, that will make it easier for user to create connector and model and try the ml_inference example below
There was a problem hiding this comment.
will link with the tutorial and starting from creating connector, creating model, deploying model, creating index and upload documents.
There was a problem hiding this comment.
@mingshl Have you added the tutorial? Once it's added, please tag me for the doc review. I'll also move it forward into editorial review.
There was a problem hiding this comment.
not yet. will create seperate PRs for the tutorials. I think this Pr is ready to merge/ Thanks @vagimeli
There was a problem hiding this comment.
@mingshl It's going through editorial and then I'll merge once editor approves. Thank you.
Signed-off-by: Mingshi Liu <[email protected]>
|
@hdhalter addressed Vale style error. It's ready for tech review. Thanks! |
Signed-off-by: Mingshi Liu <[email protected]>
vagimeli
added
5 - Editorial review
Signed-off-by: Melissa Vagi <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Yaliang Wu <[email protected]> Signed-off-by: Mingshi Liu <[email protected]>
Co-authored-by: Yaliang Wu <[email protected]> Signed-off-by: Mingshi Liu <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]> Signed-off-by: Melissa Vagi <[email protected]>
Description
Add ml inference ingest processor documentation
Issues Resolved
Closes #7041
Checklist
For more information on following Developer Certificate of Origin and signing off your commits, please check here.