New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BatchNorm momentum #64

Open

Anzoteh96 opened this issue Nov 24, 2020 · 0 comments

Anzoteh96 commented Nov 24, 2020

Hello,

Not too sure if it's an appropriate to raise this, but I felt it strange that the momentum of batch normalization is set to 0 here:

crowdcount-mcnn/src/network.py

Line 11 in e04c67f

    
           self.bn = nn.BatchNorm2d(out_channels, eps=0.001, momentum=0, affine=True) if bn else None

According to the documentation it seems that we use the average value of the first batch ever seen.

I wonder if this is intended since many guides suggest 0.1, 0.01, etc (but not 0).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment