Speech-to-text transcription

[TheRealPear]

Plugin Description

I am not sure if this is technically possible with Vencord and I don't doubt it will take a lot of work, but it would be great to see a plugin that can transcribe any intelligible audio, that being voice messages, voice chat (as long you're in an active vc and not deafened), and maybe even uploaded videos. I think this would be very useful for many people, especially those who are deaf and hard of hearing, including myself. In the past, I've used the built-in Live Captions program that is bundled with Windows 11 and other solutions like Ava, however, they tend to be clunky to set up and use.

Given that Discord client is based on Electron (and Chromium), it might be possible to use the SpeechRecognition API, that ZipCaptions, an another transcribing service, uses. The only drawback is that Google will censor any expletives, including words that sounds similar to it.

Existing Plugin for other mod

No response

Request Agreement

• I read the above and made sure my plugin is possible and allowed
• I checked the existing plugins and made sure my plugin doesn't already exist
• I searched the existing issues and made sure a similar request doesn't already exist