What do the two aggregated score numbers mean?

[justinborromeo]

Also, what are raw and ceiling?

[mschrimpf]

The two numbers correspond to the aggregate score and an estimate of the error of that score. More specifically they correspond to the two coordinates center and error in the aggregation dimension. For instance, for the standard neural predictivity metric, the center corresponds to the mean over cross-validation splits and median over neuroids. These numbers are further normalized by the ceiling (see below).

ceiling is the reliability of the benchmark; since the data come from noisy biological measurements, this tries to estimate the maximum value we would expect a model to score (in this case ~0.82).

raw in this case is the aggregate correlation (mean over splits, median over neuroids) before normalizing with the ceiling. See here for how this particular benchmark normalizes scores by the ceiling. In effect, this is just another Score object and itself contains another raw object which should be the per-split, per-neuroid correlation values, i.e. before aggregating them into a single number.

More details can be found in the benchmarks and metrics examples.