Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whisper without translation #652

Open
Plemeur opened this issue Oct 4, 2024 · 1 comment
Open

Whisper without translation #652

Plemeur opened this issue Oct 4, 2024 · 1 comment

Comments

@Plemeur
Copy link

Plemeur commented Oct 4, 2024

Hello,

I have been trying to use the whisper triton server to transcribe english and japanese, but by settings multiple languages in the text prefix <|en|><|ja|> it will always translate into the second language

I am seeing some other people reporting the same issue on different repo related to large v3, with some different tips and tricks to make it "work"

Is this a limitation of large-v3 ? Did anyone get a good result using this triton server on multi languages speech ?

@yuekaizhang
Copy link
Collaborator

@Plemeur Hi, you need to detect language first. Then set text prefix to your detected language. You can't do it by setting prompt only.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants