Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow streaming audio responses #1340

Open
BeeShall opened this issue Sep 13, 2024 · 1 comment
Open

Allow streaming audio responses #1340

BeeShall opened this issue Sep 13, 2024 · 1 comment

Comments

@BeeShall
Copy link

Is your feature request related to a problem? Please describe.
Whenever I want to use text to speech as a chatbot response, I have to wait for the response from the LLM and then use a TTS service to synthesize the results which results in a huge latency and poor UX experience.

Describe the solution you'd like
It would be really cool is cl.Audio/cl.Message allowed streaming of audio tokens so that we can stream TTS response as we get it, instead of waiting to synthesize completely.

Describe alternatives you've considered
None at the moment.

@chibexme
Copy link

I'm looking forward for this functionality as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants