Enable autograd graph to propagate after multi-device syncing (for loss functions in ddp
)
#4675
Job | Run time |
---|---|
10s | |
17m 43s | |
17m 41s | |
17m 41s | |
17m 42s | |
17m 44s | |
17m 42s | |
17m 42s | |
17m 42s | |
17m 42s | |
17m 46s | |
17m 41s | |
17m 41s | |
17m 41s | |
17m 46s | |
17m 44s | |
17m 47s | |
17m 56s | |
17m 33s | |
17m 39s | |
17m 38s | |
1m 14s | |
5h 55m 35s |