Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Connector doesn't return correct status code to client side #2618

Open
ylwu-amzn opened this issue Jul 8, 2024 · 2 comments
Open

[BUG] Connector doesn't return correct status code to client side #2618

ylwu-amzn opened this issue Jul 8, 2024 · 2 comments
Assignees
@Zhangxunmt
Labels
bug Something isn't working

Comments

@ylwu-amzn
Copy link
Collaborator

What is the bug?
Some user reports that the connector (Azure openAI) doesn't return correct throttling exception status code 429 to client side. So they can't detect that error and retry.

Related issue opensearch-project/OpenSearch#14337
@ylwu-amzn ylwu-amzn added bug Something isn't working untriaged labels Jul 8, 2024
@ylwu-amzn
Copy link
Collaborator Author

This PR aded status code to response #1443, need to debug why it doesn't return correct status code sometimes.

@b4sjoo b4sjoo moved this to Untriaged in ml-commons projects Jul 16, 2024
@b4sjoo b4sjoo moved this from Untriaged to On-deck in ml-commons projects Jul 16, 2024
@b4sjoo b4sjoo removed the untriaged label Jul 16, 2024
@b4sjoo
Copy link
Collaborator

b4sjoo commented Jul 16, 2024

Hi @ylwu-amzn, feel free to change the assignee to the most suitable one

@b4sjoo b4sjoo assigned Zhangxunmt and unassigned ylwu-amzn Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Zhangxunmt Zhangxunmt

Labels
bug Something isn't working
Projects
ml-commons projects
Status: On-deck
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Zhangxunmt @ylwu-amzn @b4sjoo