Regarding copy inputs before inference, flush the stream which copies the input only if the input is consumed by the ops from different streams #27455
Job | Run time |
---|---|
50s | |
2m 9s | |
23m 20s | |
5m 26s | |
31m 45s |
Job | Run time |
---|---|
50s | |
2m 9s | |
23m 20s | |
5m 26s | |
31m 45s |