Enable autograd graph to propagate after multi-device syncing (for loss functions in ddp
)
#4690
Job | Run time |
---|---|
7s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1m 13s | |
1m 40s |
ddp
)
#4690
Job | Run time |
---|---|
7s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1s | |
1m 13s | |
1m 40s |