Enable autograd graph to propagate after multi-device syncing (for loss functions in ddp
)
#9623
Job | Run time |
---|---|
2m 22s | |
3m 25s | |
5m 33s | |
4m 14s | |
5m 0s | |
5m 50s | |
3m 38s | |
4m 9s | |
4m 10s | |
38m 21s |
ddp
)
#9623
Job | Run time |
---|---|
2m 22s | |
3m 25s | |
5m 33s | |
4m 14s | |
5m 0s | |
5m 50s | |
3m 38s | |
4m 9s | |
4m 10s | |
38m 21s |