DGX Nightly Benchmark run 20210514 Run 2

[quasiben]

Benchmark history

Raw Data

<Client: 'tcp://127.0.0.1:41891' processes=10 threads=10, memory=503.79 GiB>
Distributed Version: 2021.04.1+20.gd6f5609a
simple
4.340e-01 +/- 4.653e-02
shuffle
1.993e+01 +/- 1.411e+00
rand_access
5.072e-03 +/- 2.351e-03
anom_mean
1.090e+02 +/- 2.760e+00

Raw Values

simple
[0.45612935 0.39268725 0.44780407 0.44288811 0.36538998 0.49458889
0.37767485 0.46481039 0.39325749 0.50486466]
shuffle
[18.93611649 19.27634822 19.1234442 19.51042038 19.34311895 19.90055382
19.00544586 19.31663521 21.06821618 23.77519999]
rand_access
[0.00803018 0.00355482 0.00472546 0.00370574 0.00393462 0.00422502
0.00335693 0.00454712 0.00365067 0.0109849 ]
anom_mean
[112.47638083 112.45600843 106.57879734 106.44787908 113.33473206
109.75315261 106.31096458 109.56764698 107.63366652 105.68108749]

Dask Profiles

• Shuffle
  Profile
• Random Access
  Profile
• Simple
  Profile
• Anom
  Mean

Scheduler Execution Graph

[jakirkham]

Run with gc.disable() and gc.set_threshold(0) from PR ( #142 )