Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Connectors] Generalise handling of streaming responses #169088

Open
dgieselaar opened this issue Oct 17, 2023 · 1 comment
Open

[Connectors] Generalise handling of streaming responses #169088

dgieselaar opened this issue Oct 17, 2023 · 1 comment
Labels
Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)

Comments

@dgieselaar
Copy link
Member

In #168440, we are implementing token count tracking for streaming responses for OpenAI inside of the framework. This is a small iteration but ideally this should be generalised. Per @mikecote:

  • We should add a capability for connector types to report extra data within their code (instead of the framework)
  • Streaming responses should generally be handled, not just for the gen-ai connector
@dgieselaar dgieselaar added the Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) label Oct 17, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)
Projects
No open projects
AppEx: ResponseOps - Execution & Connectors
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dgieselaar @mikecote @elasticmachine