DGX Nightly Benchmark run 20210308

[quasiben]

Benchmark history

Raw Data

<Client: 'tcp://127.0.0.1:40691' processes=10 threads=10, memory=540.94 GB>
Distributed Version: 2021.03.0
simple
4.696e-01 +/- 9.061e-02
shuffle
2.298e+01 +/- 2.293e+00
rand_access
9.287e-03 +/- 2.409e-03
anom_mean
8.109e+01 +/- 4.722e+01

Raw Values

simple
[0.53483725 0.47410941 0.46147776 0.23577571 0.47176147 0.48470187
0.54337502 0.58543754 0.49356413 0.41109371]
shuffle
[21.15293002 29.13965988 25.08983135 21.77071977 21.77399182 22.26738739
21.76828051 21.75249338 22.36444116 22.68556213]
rand_access
[0.00688601 0.01168561 0.00989008 0.01029468 0.01056027 0.01044488
0.01118803 0.01014662 0.00317383 0.00859904]
anom_mean
[116.91092348 118.22112346 117.96496773 22.41200876 24.36954904
126.54799962 119.58512449 118.31008959 21.93964195 24.67120814]

Dask Profiles

• Shuffle
  Profile
• Random Access
  Profile
• Simple
  Profile
• Anom
  Mean

Scheduler Execution Graph

[jakirkham]

There's a pretty stark difference between the call graph here and in the last run in issue ( #120 )

[jakirkham]

Looking around a bit. It appears reevaluate_occupancy dropped out here. There's not an obvious reason for that change since there hadn't been any changes to Distributed between this run and the previous one