Home

Welcome to the dist-gnn wiki!

Preliminary Experiments

gloo Reddit 200 full barrier

33.75s 19200 barrier 165.67s 6400 broadcast 15.91s 6400 spmm 218.40s 200 train

gloo Reddit 200 no barrier

186.31s 6400 broadcast 20.82s 6400 spmm 211.01s 200 train 950 604.95s 6400 broadcast 952 12.95s 6400 spmm 956 621.34s 200 train

nccl Reddit 200 no barrier

105.96s 6400 broadcast 10.80s 6400 spmm 117.96s 200 train

nccl Reddit 200 full barrier

50.53s 19200 barrier 61.95s 6400 broadcast 9.11s 6400 spmm 122.98s 200 train