Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to synchronized Batch Normalization? #4

Closed
amdcat opened this issue Sep 28, 2017 · 8 comments
Closed

How to synchronized Batch Normalization? #4

amdcat opened this issue Sep 28, 2017 · 8 comments
Labels

Comments

@amdcat
Copy link

amdcat commented Sep 28, 2017

Thanks for your project.
I find the BN code in encoding/init.py, but i don't konw how to use it? Is the code support multi-GPU now?

@zhanghang1989
Copy link
Owner

It is part of the multi-gpu BN, we haven't released the corresponding DataParallel code.

@amdcat
Copy link
Author

amdcat commented Sep 29, 2017

Is there any plan to release the DataParallel code?

@zhanghang1989
Copy link
Owner

My research got delayed due to visa problem. We may release it later this year.

@zhanghang1989
Copy link
Owner

@amdcat I have just released the whole system for sync BN, please check it out. Note that we will release the paper later, current please cite the 'Deep TEN' paper, if using the code. Thanks!

@mingminzhen
Copy link

I want to ask how to use sync BN. Could you give some example?

@zhanghang1989
Copy link
Owner

Examples will be provided in later version (later this month). We are preparing an arXiv paper.

@mingminzhen
Copy link

awesome.

@mingminzhen
Copy link

I am waiting for the example and paper. When are you ready for that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants