New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

In SGD, why set default dampening to momentum? #163

Open

YurongYou opened this issue Sep 29, 2017 · 1 comment

YurongYou commented Sep 29, 2017

Line 35 in 656c42a

local damp = config.dampening or mom

lucasb-eyer commented Jan 3, 2018

This actually de-couples the dampening and momentum. Look at how it is used in the code, all other frameworks use "mom" instead of "damp" hard-coded.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment