-
Notifications
You must be signed in to change notification settings - Fork 271
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CTC loss is 0 on GPU Tesla V100 #162
Comments
facing the same problem on longer audios of around 40-60 seconds. |
I have solved the problem, just put the input of ctc loss on cpu for example , CTC(acts, labels, act_lens, label_lens), do acts.cpu() before run CTC loss |
The ctc loss will return 0 on errors. One is the ctc loss is not compiled with cuda support but got cuda tensor input. Another situation is input sequence is too long. |
I also face the same problem. so I want to know how to check the ctc loss is compiled with cuda or not. and, if it really isn't compiled, what can I do to make them compiled. thanks a lot!!! |
@IAASSIBLCU I would recommend you to try using PyTorch CTC. |
I too would also suggest using PyTorch CTC :) this library is fairly old, and I've also moved this project to use it successfully: https://github.com/SeanNaren/deepspeech.pytorch |
@raotnameh @SeanNaren thanks a lot!! I will try PyTorch CTC in my project. Hope to get the dream result. |
I get the problem of continuously get zero loss (loss = 0) on GPU Tesla V100,if anyone got the same problem or have some solutions?
The text was updated successfully, but these errors were encountered: