-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
no perforamnce improvement with GPU #3
Comments
xuyuan
changed the title
no perforamnce inprovement with GPU
no perforamnce improvement with GPU
Nov 21, 2018
Hi, thanks! I need to check this issue in more detail, but I will be back to it when I have more time. I was testing on CPU and I was getting performance gain and reduced memory usage. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I have benchmarked with resnet50, resnet101, the bn_fusion performance improves with CPU (about 7%), but no improvement with cuda.
There is no noticeably difference between
torch.cuda.cudnn.benchmark
true and false.My guess is that cudnn can optimize such case really good already.
my test code: https://github.com/xuyuan/pytorch_bn_fusion/blob/master/test_convert_inference.py
The text was updated successfully, but these errors were encountered: