Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should I use bias in convolution ops? #7

Open
wcyjerry opened this issue Oct 19, 2021 · 0 comments
Open

Should I use bias in convolution ops? #7

wcyjerry opened this issue Oct 19, 2021 · 0 comments

Comments

@wcyjerry
Copy link

I realized that the slim.con2d,if you use the normalizer_fn , it says the conv will have no bias.
but there comes the question since it uses adaptive BN ,as I can see in the code the initial parameter is w0=1 and w1=0, which means at first it doesn't use batch normalization, So the bias is used in futher forward-propagation.and even though w1 is not 0, as long as the w0 do not becoming to 0, I think the bias is still used in someway.So,Should I use bias in conv?I was doing this in pytorch.it doesn't have a function like slim.conv2d.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant