-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tts/stt and styling #25
tts/stt and styling #25
Conversation
chatbot = gradio.Chatbot(label=description) | ||
textbox = gradio.Textbox(placeholder=placeholder) | ||
|
||
with self.chat_ui as blocks: | ||
# Define primary UI | ||
audio_input = gradio.Audio(source="microphone", | ||
type="filepath", | ||
label="Talk to NEON", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should read from config
@@ -283,7 +283,8 @@ def _send_audio(self, audio_file: str, lang: str, | |||
audio_data = encode_file_to_base64_string(audio_file) | |||
message = self._build_message("neon.audio_input", | |||
{"lang": lang, | |||
"audio_data": audio_data}, | |||
"audio_data": audio_data, | |||
"utterances": []}, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should have a TODO note that its patching a connector bug
ovos-bus-client~=0.0.3 | ||
librosa~=0.10.1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should probably be replaced with neon-utils[audio]
Update documentation Add missing system deps to Dockerfile
* Initial Gradio web UI implementation with Dockerfile * Initial outline of settings with UI * Annotate web_client Move hard-coded params to configuration Update README to include configuration example Update Docker default configuration Add Docker automation * wip tts/stt and styling * add stt/tts, rearrange interface * Address feedback from #25 Update documentation Add missing system deps to Dockerfile * Patch audioread missing license (MIT) https://github.com/beetbox/audioread/blob/main/LICENSE * Refactor `docker` dependencies to `gradio` Cleanup logging Refactor to resolve warnings Resolve missing directory exception in audio input handling * Fix STT language handling --------- Co-authored-by: Daniel McKnight <[email protected]> Co-authored-by: mikejgray <[email protected]>
Everything works, but nothing is auto-playing or auto-submitting yet. I should be able to get the auto-submit for the voice recording with a little extra work. Autoplay should already be working, so that needs to be debugged.