Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the bias term and initialization #31

Open
Joechann0831 opened this issue Dec 17, 2018 · 1 comment
Open

About the bias term and initialization #31

Joechann0831 opened this issue Dec 17, 2018 · 1 comment

Comments

@Joechann0831
Copy link

Hi, thank you for your sharing. I have two questions about your code in vdsr.py:
1, Why do you set the bias term as False? The official VDSR model contains bias term, is this a trick for a better performance?
2, The initialization you use in this code is
m.weight.data.normal_(0, sqrt(2./n))
Is this the initialization with MSRA method? How about using nn.init?

Thank you very much.

@cjsoft
Copy link

cjsoft commented Aug 19, 2019

when i was implenting vdsr on another dl framework, I found model with bias=false performs very bad on B100 2x. Not sure why.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants