New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

显存小的GPU跑起来很容易梯度爆炸 #16

Open

mafamily2496 opened this issue May 26, 2019 · 4 comments

mafamily2496 commented May 26, 2019

救救只有4G显存的用户吧。。。batch_size只能设成2，跑起来动不动就梯度爆炸。。。该怎么办

Author

mafamily2496 commented May 26, 2019

把batchnorm改成groupnorm有用么

121649982 commented Jan 17, 2020

我也是

njustymk commented Dec 18, 2020

不是显存的问题，我昨天刚跑的，24G显存，batch是16，loss依然会inf

njustymk commented Dec 18, 2020

lr调小一些应该会好点

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment