Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tts/stt and styling #25

Merged
merged 2 commits into from
Nov 6, 2023

Conversation

mikejgray
Copy link
Contributor

@mikejgray mikejgray commented Nov 6, 2023

Everything works, but nothing is auto-playing or auto-submitting yet. I should be able to get the auto-submit for the voice recording with a little extra work. Autoplay should already be working, so that needs to be debugged.

@mikejgray mikejgray changed the title wip tts/stt and styling tts/stt and styling Nov 6, 2023
chatbot = gradio.Chatbot(label=description)
textbox = gradio.Textbox(placeholder=placeholder)

with self.chat_ui as blocks:
# Define primary UI
audio_input = gradio.Audio(source="microphone",
type="filepath",
label="Talk to NEON",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should read from config

@@ -283,7 +283,8 @@ def _send_audio(self, audio_file: str, lang: str,
audio_data = encode_file_to_base64_string(audio_file)
message = self._build_message("neon.audio_input",
{"lang": lang,
"audio_data": audio_data},
"audio_data": audio_data,
"utterances": []},
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should have a TODO note that its patching a connector bug

ovos-bus-client~=0.0.3
librosa~=0.10.1
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should probably be replaced with neon-utils[audio]

@NeonDaniel NeonDaniel merged commit 0c4c2bd into NeonGeckoCom:FEAT_GradioUi Nov 6, 2023
6 checks passed
NeonDaniel added a commit that referenced this pull request Nov 7, 2023
Update documentation
Add missing system deps to Dockerfile
NeonDaniel added a commit that referenced this pull request Nov 7, 2023
* Initial Gradio web UI implementation with Dockerfile

* Initial outline of settings with UI

* Annotate web_client
Move hard-coded params to configuration
Update README to include configuration example
Update Docker default configuration
Add Docker automation

* wip tts/stt and styling

* add stt/tts, rearrange interface

* Address feedback from #25
Update documentation
Add missing system deps to Dockerfile

* Patch audioread missing license (MIT) https://github.com/beetbox/audioread/blob/main/LICENSE

* Refactor `docker` dependencies to `gradio`
Cleanup logging
Refactor to resolve warnings
Resolve missing directory exception in audio input handling

* Fix STT language handling

---------

Co-authored-by: Daniel McKnight <[email protected]>
Co-authored-by: mikejgray <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants