Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: #825

Open
4 tasks done
patrickreinan opened this issue Oct 25, 2024 · 1 comment
Open
4 tasks done

bug: #825

patrickreinan opened this issue Oct 25, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@patrickreinan
Copy link

Did you check docs and existing issues?

  • I have read all the NeMo-Guardrails docs
  • I have updated the package to the latest version before submitting this issue
  • (optional) I have used the develop branch
  • I have searched the existing issues of NeMo-Guardrails

Python version (python --version)

Python 3.10

Operating system/version

Debian (Docker image)

NeMo-Guardrails version (if you must use a specific version and not the latest

0.10.1

Describe the bug

When I try to use NeMo Guardrails with Amazon Bedrock I face a issue with message

ValidationException: An error occurred (ValidationException) when calling the InvokeModel operation: Malformed input request: #: extraneous key [max_tokens] is not permitted#: extraneous key [n] is not permitted, please reformat your input and try again.

Checking the code, I perceived a hard coded max_tokens: 10 parameter for kwargs.

Steps To Reproduce

Configure a rail using Amazon Bedrock

Expected Behavior

NeMo Guardrails answer with LLM response

Actual Behavior

A error occurs:

ValidationException: An error occurred (ValidationException) when calling the InvokeModel operation: Malformed input request: #: extraneous key [max_tokens] is not permitted#: extraneous key [n] is not permitted, please reformat your input and try again.
@patrickreinan patrickreinan added the bug Something isn't working label Oct 25, 2024
@patrickreinan
Copy link
Author

patrickreinan commented Oct 25, 2024

This pull request fixes this bug. #822

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant