Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Support remote guardrails model #2377

Closed
jngz-es opened this issue Apr 30, 2024 · 2 comments
Closed

[FEATURE] Support remote guardrails model #2377

jngz-es opened this issue Apr 30, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request v2.15.0

Comments

@jngz-es
Copy link
Collaborator

jngz-es commented Apr 30, 2024

Is your feature request related to a problem?
Improve guardrails performance.

What solution would you like?
Call remote guardrails model to check user input and model output.

What alternatives have you considered?
We already have an alternative using stop words and regex to validate input/output.

Do you have any additional context?
None.

@jngz-es jngz-es self-assigned this Apr 30, 2024
@jngz-es jngz-es removed the untriaged label Apr 30, 2024
@xinyual
Copy link
Collaborator

xinyual commented May 7, 2024

Do we have any design for that? For example, we will call it parallel when we using agent execute API? Can we design it as a function/method so I can reuse it in PPL Tool in skills repo?

@jngz-es
Copy link
Collaborator Author

jngz-es commented May 7, 2024

Hi @xinyual , we plan to only add a new type for the current guardrail implementation. I believe you can reuse it for PPL tool, as it works on model level, runs in model prediction process. So it doesn't matter with agent execute API.

@dhrubo-os dhrubo-os moved this to In Progress in ml-commons projects May 7, 2024
@dhrubo-os dhrubo-os added the enhancement New feature or request label May 7, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in ml-commons projects Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request v2.15.0
Projects
Development

No branches or pull requests

4 participants