Add optional prompt template transformation in input transform #379
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
For RAG use cases, users may want to configure the prompt templates directly in the ML processors, dynamically using data inputs as part of the prompt. For example, collecting a list of documents as context to pass to an LLM to summarize and return a human-readable response.
This PR adds a component in the input transform modal to view the original prompt template, and the prompt template with any injected input values (if applicable).
More details:
InputTransformModal
prompt
field is found in the processor'smodel_config
fieldwrap=true
so long values (e.g., prompts) don't stretch out on one lineNote this is just a first iteration at exposing the prompt template in the transform modal, and being able to see the finally-produced template that the model will receive. It will likely change, handle more edge case states, handle direct prompt manipulation, more details, etc. in the future.
Demo video, showing the prompt template being populated with parameter values:
screen-capture.22.webm
Issues resolved
Makes progress on #380
Check List
--signoff
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.