K8s-snap integration test with k8s-dqlite changes

[louiseschmidtgen]

K8s-snap integration test with k8s-dqlite changes

This PR adds a test for our newest changes of k8s-dqlite against our latest k8s-snap.
Through this test we can guarantee k8s features (network, ingress, gateway, storage, etc) work as expected.

[github-actions]

Benchmark Result

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │    Before     │                After                │
                                        │    sec/op     │    sec/op      vs base              │
Compaction/sqlite-4                       33.99µ ±  11%   35.45µ ±  14%       ~ (p=0.209 n=7)
Compaction/dqlite-4                       40.30µ ±   4%   39.39µ ±   7%       ~ (p=0.902 n=7)
Create/sqlite/1-workers-4                 1.069m ±   3%   1.058m ±   5%       ~ (p=0.710 n=7)
Create/sqlite/4-workers-4                 1.154m ±   8%   1.167m ±  10%       ~ (p=1.000 n=7)
Create/sqlite/16-workers-4                1.421m ±  69%   1.455m ±  20%       ~ (p=0.805 n=7)
Create/sqlite/64-workers-4                15.50m ±  50%   15.51m ±  31%       ~ (p=0.620 n=7)
Create/sqlite/128-workers-4               21.56m ±  36%   16.73m ± 167%       ~ (p=0.456 n=7)
Create/dqlite/1-workers-4                 956.8µ ±   2%   931.5µ ±   7%       ~ (p=0.053 n=7)
Create/dqlite/4-workers-4                 834.6µ ±   3%   815.7µ ±   5%       ~ (p=0.259 n=7)
Create/dqlite/16-workers-4                849.4µ ±   2%   830.7µ ±   3%       ~ (p=0.097 n=7)
Create/dqlite/64-workers-4                843.4µ ±   4%   836.1µ ±   2%       ~ (p=0.259 n=7)
Create/dqlite/128-workers-4               842.6µ ±   2%   849.6µ ±   2%       ~ (p=0.902 n=7)
Delete/sqlite/1-workers-4                 1.124m ±   8%   1.093m ±   2%       ~ (p=0.053 n=7)
Delete/sqlite/4-workers-4                 1.178m ±   7%   1.177m ±   5%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                1.508m ±  13%   1.703m ±  18%       ~ (p=0.053 n=7)
Delete/sqlite/64-workers-4                13.56m ±  74%   11.85m ±  89%       ~ (p=0.535 n=7)
Delete/sqlite/128-workers-4               16.63m ±  56%   18.85m ± 131%       ~ (p=0.259 n=7)
Delete/dqlite/1-workers-4                 949.3µ ±   3%   951.3µ ±   6%       ~ (p=0.259 n=7)
Delete/dqlite/4-workers-4                 849.8µ ±   3%   845.8µ ±   3%       ~ (p=0.805 n=7)
Delete/dqlite/16-workers-4                840.1µ ±   2%   833.0µ ±   3%       ~ (p=0.259 n=7)
Delete/dqlite/64-workers-4                844.9µ ±   2%   849.4µ ±   4%       ~ (p=0.620 n=7)
Delete/dqlite/128-workers-4               849.2µ ±   2%   854.3µ ±   4%       ~ (p=0.209 n=7)
Get/sqlite-4                              268.0µ ±   1%   270.6µ ±   1%  +0.97% (p=0.007 n=7)
Get/dqlite-4                              357.4µ ±   1%   359.5µ ±   1%       ~ (p=0.259 n=7)
List/sqlite-tiny/all-4                    4.424µ ±   2%   4.413µ ±   3%       ~ (p=0.456 n=7)
List/sqlite-tiny/pagination-4             8.908µ ±   5%   8.750µ ±   3%       ~ (p=0.097 n=7)
List/sqlite-fits-in-page/all-4            7.327µ ±   3%   7.076µ ±   2%  -3.43% (p=0.002 n=7)
List/sqlite-fits-in-page/pagination-4     22.24µ ±   5%   22.03µ ±   3%       ~ (p=0.456 n=7)
List/sqlite-overflows-page/all-4          17.22µ ±   7%   17.47µ ±   6%       ~ (p=0.456 n=7)
List/sqlite-overflows-page/pagination-4   45.76µ ±   3%   45.48µ ±   4%       ~ (p=0.456 n=7)
List/dqlite-tiny/all-4                    2.803µ ±   4%   2.846µ ±   9%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4             5.910µ ±   3%   5.937µ ±   2%       ~ (p=0.559 n=7)
List/dqlite-fits-in-page/all-4            5.944µ ±   4%   5.931µ ±   2%       ~ (p=0.364 n=7)
List/dqlite-fits-in-page/pagination-4     16.00µ ±   4%   15.90µ ±   3%       ~ (p=0.473 n=7)
List/dqlite-overflows-page/all-4          17.79µ ±   2%   17.98µ ±   3%       ~ (p=0.259 n=7)
List/dqlite-overflows-page/pagination-4   40.99µ ±   3%   39.79µ ±   7%  -2.92% (p=0.038 n=7)
Update/sqlite/1-workers-4                 1.076m ±   4%   1.070m ±   4%       ~ (p=0.535 n=7)
Update/sqlite/4-workers-4                 1.138m ±   7%   1.172m ±  18%       ~ (p=0.456 n=7)
Update/sqlite/16-workers-4                1.504m ±  29%   1.431m ±  19%       ~ (p=0.805 n=7)
Update/sqlite/64-workers-4                 1.355 ± 103%    1.145 ± 149%       ~ (p=0.902 n=7)
Update/sqlite/128-workers-4                2.653 ±  87%    2.794 ±  37%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                 939.3µ ±   2%   943.5µ ±   2%       ~ (p=0.902 n=7)
Update/dqlite/4-workers-4                 831.0µ ±   4%   835.2µ ±   7%       ~ (p=0.805 n=7)
Update/dqlite/16-workers-4                806.1µ ±   4%   808.2µ ±   3%       ~ (p=0.209 n=7)
Update/dqlite/64-workers-4                816.6µ ±   5%   838.4µ ±   4%       ~ (p=0.128 n=7)
Update/dqlite/128-workers-4               841.3µ ±   6%   873.1µ ±   5%       ~ (p=0.128 n=7)
geomean                                   451.9µ          448.8µ         -0.68%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │ page-reads/op │ page-reads/op  vs base              │
Compaction/sqlite-4                         12.20 ±  1%    12.21 ±   1%       ~ (p=0.779 n=7)
Compaction/dqlite-4                         12.21 ±  1%    12.18 ±   2%       ~ (p=0.973 n=7)
Create/sqlite/1-workers-4                   14.35 ±  0%    14.33 ±   1%       ~ (p=0.399 n=7)
Create/sqlite/4-workers-4                   13.66 ±  6%    13.89 ±   4%       ~ (p=0.383 n=7)
Create/sqlite/16-workers-4                  12.83 ± 12%    12.73 ±  12%       ~ (p=1.000 n=7)
Create/sqlite/64-workers-4                  5.300 ± 21%    5.190 ±   7%       ~ (p=0.119 n=7)
Create/sqlite/128-workers-4                 4.960 ± 11%    4.880 ±  16%       ~ (p=0.875 n=7)
Create/dqlite/1-workers-4                   13.41 ±  2%    13.34 ±   1%       ~ (p=0.402 n=7)
Create/dqlite/4-workers-4                   10.91 ±  1%    10.87 ±   2%       ~ (p=0.220 n=7)
Create/dqlite/16-workers-4                  11.00 ±  3%    10.93 ±   1%       ~ (p=0.079 n=7)
Create/dqlite/64-workers-4                  11.06 ±  1%    10.96 ±   1%  -0.90% (p=0.011 n=7)
Create/dqlite/128-workers-4                 11.03 ±  2%    10.96 ±   1%       ~ (p=0.068 n=7)
Delete/sqlite/1-workers-4                   16.59 ± 14%    16.73 ±   5%       ~ (p=0.403 n=7)
Delete/sqlite/4-workers-4                   16.52 ± 14%    15.91 ±   8%       ~ (p=0.209 n=7)
Delete/sqlite/16-workers-4                  15.28 ± 16%    14.81 ±   8%       ~ (p=0.383 n=7)
Delete/sqlite/64-workers-4                  7.562 ± 33%    7.890 ±  27%       ~ (p=0.644 n=7)
Delete/sqlite/128-workers-4                 6.750 ± 15%    6.200 ±   8%       ~ (p=0.383 n=7)
Delete/dqlite/1-workers-4                   15.73 ±  1%    15.63 ±   2%       ~ (p=0.402 n=7)
Delete/dqlite/4-workers-4                   13.23 ±  1%    13.18 ±   1%       ~ (p=0.332 n=7)
Delete/dqlite/16-workers-4                  13.39 ±  1%    13.20 ±   1%  -1.42% (p=0.003 n=7)
Delete/dqlite/64-workers-4                  13.24 ±  1%    13.24 ±   1%       ~ (p=0.504 n=7)
Delete/dqlite/128-workers-4                 13.14 ±  3%    13.18 ±   1%       ~ (p=0.217 n=7)
Get/sqlite-4                                14.95 ±  0%    14.96 ±   0%       ~ (p=0.898 n=7)
Get/dqlite-4                                11.97 ±  0%    11.95 ±   0%       ~ (p=0.417 n=7)
List/sqlite-tiny/all-4                     192.3m ±  0%   192.2m ±   0%       ~ (p=0.609 n=7)
List/sqlite-tiny/pagination-4               1.132 ±  3%    1.132 ±   3%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4             164.9m ±  0%   164.9m ±   0%       ~ (p=0.400 n=7)
List/sqlite-fits-in-page/pagination-4      965.4m ±  0%   965.6m ±   0%       ~ (p=0.073 n=7)
List/sqlite-overflows-page/all-4           274.1m ± 28%   262.3m ±  20%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4     2.080 ±  0%    2.080 ±   2%       ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                     191.1m ±  0%   191.2m ±   1%       ~ (p=0.882 n=7)
List/dqlite-tiny/pagination-4               1.126 ±  3%    1.126 ±   3%       ~ (p=0.755 n=7)
List/dqlite-fits-in-page/all-4             163.2m ± 59%   163.1m ±   0%       ~ (p=0.429 n=7)
List/dqlite-fits-in-page/pagination-4      954.3m ±  3%   954.2m ±   3%       ~ (p=0.872 n=7)
List/dqlite-overflows-page/all-4           182.7m ±  0%   182.7m ±   0%       ~ (p=0.396 n=7)
List/dqlite-overflows-page/pagination-4     1.071 ±  3%    1.070 ±   3%       ~ (p=0.307 n=7)
Update/sqlite/1-workers-4                   16.43 ±  0%    16.40 ±   0%       ~ (p=0.531 n=7)
Update/sqlite/4-workers-4                   16.00 ±  2%    15.87 ±   1%       ~ (p=0.068 n=7)
Update/sqlite/16-workers-4                  15.30 ±  3%    15.33 ±   3%       ~ (p=0.902 n=7)
Update/sqlite/64-workers-4                  287.0 ± 74%    158.0 ± 111%       ~ (p=0.902 n=7)
Update/sqlite/128-workers-4                 573.0 ±  9%    602.0 ±  12%       ~ (p=0.196 n=7)
Update/dqlite/1-workers-4                   15.58 ±  1%    15.41 ±   1%  -1.09% (p=0.035 n=7)
Update/dqlite/4-workers-4                   12.79 ±  2%    12.69 ±   1%  -0.78% (p=0.016 n=7)
Update/dqlite/16-workers-4                  12.84 ±  1%    12.70 ±   1%  -1.09% (p=0.009 n=7)
Update/dqlite/64-workers-4                  12.89 ±  4%    12.86 ±   3%       ~ (p=0.833 n=7)
Update/dqlite/128-workers-4                 13.28 ±  4%    13.28 ±   4%       ~ (p=0.706 n=7)
geomean                                     6.101          5.993         -1.77%

                                        │     Before     │                 After                  │
                                        │ page-writes/op │ page-writes/op  vs base                │
Compaction/sqlite-4                       207.9m ±  0%      207.9m ±   1%       ~ (p=0.972 n=7)
Compaction/dqlite-4                       187.3m ±  1%      187.4m ±   1%       ~ (p=0.439 n=7)
Create/sqlite/1-workers-4                  5.226 ±  0%       5.224 ±   1%       ~ (p=0.271 n=7)
Create/sqlite/4-workers-4                  5.143 ±  2%       5.154 ±   1%       ~ (p=0.805 n=7)
Create/sqlite/16-workers-4                 5.092 ±  1%       5.105 ±   0%       ~ (p=0.176 n=7)
Create/sqlite/64-workers-4                 5.000 ±  0%       5.000 ±   0%       ~ (p=1.000 n=7)
Create/sqlite/128-workers-4                5.000 ±  0%       5.000 ±   0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                  4.282 ±  1%       4.284 ±   1%       ~ (p=0.555 n=7)
Create/dqlite/4-workers-4                  4.315 ±  0%       4.314 ±   0%       ~ (p=0.216 n=7)
Create/dqlite/16-workers-4                 4.311 ±  0%       4.312 ±   0%       ~ (p=0.928 n=7)
Create/dqlite/64-workers-4                 4.309 ±  0%       4.313 ±   0%       ~ (p=0.328 n=7)
Create/dqlite/128-workers-4                4.305 ±  0%       4.305 ±   0%       ~ (p=0.727 n=7)
Delete/sqlite/1-workers-4                  5.330 ±  1%       5.305 ±   1%       ~ (p=0.195 n=7)
Delete/sqlite/4-workers-4                  5.316 ±  1%       5.292 ±   1%       ~ (p=0.090 n=7)
Delete/sqlite/16-workers-4                 5.236 ±  1%       5.282 ±   1%       ~ (p=0.057 n=7)
Delete/sqlite/64-workers-4                 5.070 ±  2%       5.070 ±   2%       ~ (p=0.783 n=7)
Delete/sqlite/128-workers-4                5.070 ±  0%       5.070 ±   0%       ~ (p=1.000 n=7)
Delete/dqlite/1-workers-4                  4.367 ±  1%       4.361 ±   1%       ~ (p=0.619 n=7)
Delete/dqlite/4-workers-4                  4.373 ±  0%       4.376 ±   0%  +0.07% (p=0.027 n=7)
Delete/dqlite/16-workers-4                 4.370 ±  1%       4.380 ±   0%       ~ (p=0.648 n=7)
Delete/dqlite/64-workers-4                 4.364 ±  1%       4.363 ±   1%       ~ (p=0.645 n=7)
Delete/dqlite/128-workers-4                4.350 ±  1%       4.353 ±   1%       ~ (p=0.837 n=7)
Get/sqlite-4                               0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±  0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                  5.193 ±  0%       5.194 ±   0%       ~ (p=0.395 n=7)
Update/sqlite/4-workers-4                  5.232 ±  1%       5.209 ±   1%       ~ (p=0.596 n=7)
Update/sqlite/16-workers-4                 5.262 ±  1%       5.237 ±   1%       ~ (p=0.073 n=7)
Update/sqlite/64-workers-4                 320.0 ± 75%       160.0 ± 100%       ~ (p=1.000 n=7)
Update/sqlite/128-workers-4                642.0 ±  0%       642.0 ±   0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                  4.216 ±  0%       4.217 ±   0%       ~ (p=0.539 n=7)
Update/dqlite/4-workers-4                  4.225 ±  0%       4.225 ±   1%       ~ (p=0.958 n=7)
Update/dqlite/16-workers-4                 4.236 ±  1%       4.232 ±   1%       ~ (p=0.736 n=7)
Update/dqlite/64-workers-4                 4.283 ±  3%       4.343 ±   3%       ~ (p=0.318 n=7)
Update/dqlite/128-workers-4                4.459 ±  4%       4.472 ±   3%       ~ (p=0.805 n=7)
geomean                                                ²                   -1.46%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                 After                 │
                                        │ sec-reading/op │ sec-reading/op   vs base              │
Compaction/sqlite-4                        114.1µ ±   3%    112.1µ ±   15%       ~ (p=0.318 n=7)
Compaction/dqlite-4                        29.00µ ±  17%    24.20µ ±   31%       ~ (p=0.073 n=7)
Create/sqlite/1-workers-4                  38.70µ ± 259%    42.50µ ±  853%       ~ (p=1.000 n=7)
Create/sqlite/4-workers-4                  68.30µ ± 564%    42.10µ ±   85%       ~ (p=0.259 n=7)
Create/sqlite/16-workers-4                 40.70µ ± 339%    48.40µ ± 1589%       ~ (p=0.710 n=7)
Create/sqlite/64-workers-4                 580.0µ ± 538%    460.0µ ±  624%       ~ (p=0.476 n=7)
Create/sqlite/128-workers-4                3.390m ± 115%    1.330m ±  450%       ~ (p=0.620 n=7)
Create/dqlite/1-workers-4                  9.400µ ±  51%   11.200µ ±   52%       ~ (p=0.620 n=7)
Create/dqlite/4-workers-4                  12.50µ ±  54%    11.50µ ±   50%       ~ (p=0.805 n=7)
Create/dqlite/16-workers-4                 11.30µ ±  40%    11.80µ ±   39%       ~ (p=0.740 n=7)
Create/dqlite/64-workers-4                 10.40µ ±  43%    11.60µ ±   35%       ~ (p=0.165 n=7)
Create/dqlite/128-workers-4                10.30µ ±  47%    10.80µ ±   48%       ~ (p=0.778 n=7)
Delete/sqlite/1-workers-4                  283.3µ ± 259%    218.2µ ±  136%       ~ (p=0.318 n=7)
Delete/sqlite/4-workers-4                  277.2µ ± 254%    319.3µ ±  164%       ~ (p=0.710 n=7)
Delete/sqlite/16-workers-4                 194.2µ ± 571%    481.9µ ±  127%       ~ (p=0.383 n=7)
Delete/sqlite/64-workers-4                 1.390m ± 224%    1.080m ±  225%       ~ (p=0.805 n=7)
Delete/sqlite/128-workers-4                2.070m ± 100%    2.600m ±  219%       ~ (p=0.318 n=7)
Delete/dqlite/1-workers-4                  13.50µ ±  39%    15.20µ ±   44%       ~ (p=0.805 n=7)
Delete/dqlite/4-workers-4                  14.40µ ±  39%    17.10µ ±   41%       ~ (p=0.196 n=7)
Delete/dqlite/16-workers-4                 18.10µ ±  23%    17.00µ ±   28%       ~ (p=0.245 n=7)
Delete/dqlite/64-workers-4                 15.20µ ±  25%    14.70µ ±   31%       ~ (p=0.902 n=7)
Delete/dqlite/128-workers-4                15.40µ ±  34%    18.10µ ±   22%       ~ (p=0.128 n=7)
Get/sqlite-4                               90.70µ ±   4%    90.20µ ±    3%       ~ (p=0.733 n=7)
Get/dqlite-4                               32.10µ ±  25%    34.10µ ±   17%       ~ (p=0.805 n=7)
List/sqlite-tiny/all-4                     14.20µ ±   4%    14.10µ ±    4%       ~ (p=0.481 n=7)
List/sqlite-tiny/pagination-4              19.20µ ±   4%    18.70µ ±    4%       ~ (p=0.103 n=7)
List/sqlite-fits-in-page/all-4             16.50µ ±  10%    16.60µ ±  173%       ~ (p=0.399 n=7)
List/sqlite-fits-in-page/pagination-4      59.30µ ±   4%    58.10µ ±    3%       ~ (p=0.128 n=7)
List/sqlite-overflows-page/all-4           53.50µ ±  30%    54.00µ ±   17%       ~ (p=0.902 n=7)
List/sqlite-overflows-page/pagination-4    167.7µ ±   2%    167.8µ ±    2%       ~ (p=0.513 n=7)
List/dqlite-tiny/all-4                     4.000µ ±  20%    4.000µ ±   22%       ~ (p=0.831 n=7)
List/dqlite-tiny/pagination-4              9.500µ ±   8%    9.300µ ±   18%       ~ (p=0.821 n=7)
List/dqlite-fits-in-page/all-4             10.10µ ±  14%    10.00µ ±   17%       ~ (p=0.625 n=7)
List/dqlite-fits-in-page/pagination-4      23.30µ ±   4%    24.70µ ±   14%  +6.01% (p=0.048 n=7)
List/dqlite-overflows-page/all-4           31.20µ ±   2%    31.30µ ±    2%       ~ (p=0.304 n=7)
List/dqlite-overflows-page/pagination-4    73.40µ ±  13%    67.00µ ±   12%       ~ (p=0.070 n=7)
Update/sqlite/1-workers-4                  28.50µ ±  38%    45.90µ ±  181%       ~ (p=0.274 n=7)
Update/sqlite/4-workers-4                  38.90µ ±  39%    43.90µ ±  667%       ~ (p=0.456 n=7)
Update/sqlite/16-workers-4                 61.70µ ±  88%    33.50µ ±  886%       ~ (p=0.620 n=7)
Update/sqlite/64-workers-4                 31.00m ± 490%    11.00m ±  482%       ~ (p=0.259 n=7)
Update/sqlite/128-workers-4                541.0m ±  88%    338.0m ±  561%       ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                  9.500µ ±  77%    9.700µ ±   45%       ~ (p=0.535 n=7)
Update/dqlite/4-workers-4                  14.10µ ±  34%    10.40µ ±   48%       ~ (p=0.165 n=7)
Update/dqlite/16-workers-4                 12.30µ ±  31%    11.00µ ±   38%       ~ (p=0.175 n=7)
Update/dqlite/64-workers-4                 11.10µ ±  40%    11.20µ ±   27%       ~ (p=0.644 n=7)
Update/dqlite/128-workers-4               10.100µ ±  52%    8.600µ ±  103%       ~ (p=0.559 n=7)
geomean                                    54.94µ           52.29µ          -4.84%

                                        │     Before      │                 After                  │
                                        │ sec-writing/op  │ sec-writing/op  vs base                │
Compaction/sqlite-4                       8.800µ ±  17%     10.100µ ±  11%       ~ (p=0.080 n=7)
Compaction/dqlite-4                       7.200µ ±   7%      6.900µ ±   9%       ~ (p=0.292 n=7)
Create/sqlite/1-workers-4                 825.9µ ±   6%      819.4µ ±   5%       ~ (p=0.383 n=7)
Create/sqlite/4-workers-4                 3.289m ±  24%      3.233m ±  10%       ~ (p=0.620 n=7)
Create/sqlite/16-workers-4                12.15m ±  57%      12.92m ±  29%       ~ (p=0.902 n=7)
Create/sqlite/64-workers-4                225.3m ±  50%      166.4m ±  55%       ~ (p=0.259 n=7)
Create/sqlite/128-workers-4               407.4m ±  68%      307.5m ± 375%       ~ (p=0.456 n=7)
Create/dqlite/1-workers-4                 39.10µ ±  24%      36.40µ ±  30%       ~ (p=0.456 n=7)
Create/dqlite/4-workers-4                 43.30µ ±  30%      41.70µ ±  34%       ~ (p=0.927 n=7)
Create/dqlite/16-workers-4                43.40µ ±  14%      38.30µ ±  19%       ~ (p=0.097 n=7)
Create/dqlite/64-workers-4                43.00µ ±  31%      39.90µ ±  19%       ~ (p=0.902 n=7)
Create/dqlite/128-workers-4               42.80µ ±  16%      45.50µ ±  20%       ~ (p=0.620 n=7)
Delete/sqlite/1-workers-4                 893.1µ ±  11%      865.1µ ±   3%       ~ (p=0.209 n=7)
Delete/sqlite/4-workers-4                 2.848m ±  21%      3.171m ±  23%       ~ (p=0.073 n=7)
Delete/sqlite/16-workers-4                13.08m ±  15%      13.73m ±  21%       ~ (p=0.535 n=7)
Delete/sqlite/64-workers-4                215.5m ±  65%      180.4m ±  80%       ~ (p=0.620 n=7)
Delete/sqlite/128-workers-4               392.9m ±  74%      371.0m ± 203%       ~ (p=0.710 n=7)
Delete/dqlite/1-workers-4                 39.20µ ±  14%      37.20µ ±  27%       ~ (p=0.596 n=7)
Delete/dqlite/4-workers-4                 40.00µ ±  16%      42.40µ ±  26%       ~ (p=0.736 n=7)
Delete/dqlite/16-workers-4                41.70µ ±  33%      42.50µ ±  11%       ~ (p=0.973 n=7)
Delete/dqlite/64-workers-4                42.40µ ±  24%      43.10µ ±  18%       ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               40.20µ ±  23%      42.00µ ±  11%       ~ (p=1.000 n=7)
Get/sqlite-4                               0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±   0%       0.000 ±   0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                 808.4µ ±   5%      818.4µ ±   7%       ~ (p=0.594 n=7)
Update/sqlite/4-workers-4                 3.329m ±  17%      3.252m ±  23%       ~ (p=1.000 n=7)
Update/sqlite/16-workers-4                12.78m ±  25%      12.42m ±  18%       ~ (p=0.197 n=7)
Update/sqlite/64-workers-4                 13.30 ± 227%       12.71 ± 208%       ~ (p=1.000 n=7)
Update/sqlite/128-workers-4                81.72 ± 104%       80.68 ±  36%       ~ (p=0.710 n=7)
Update/dqlite/1-workers-4                 36.30µ ±  21%      34.40µ ±  40%       ~ (p=0.710 n=7)
Update/dqlite/4-workers-4                 39.70µ ±  12%      39.10µ ±  12%       ~ (p=0.805 n=7)
Update/dqlite/16-workers-4                43.10µ ±  20%      41.60µ ±  21%       ~ (p=0.779 n=7)
Update/dqlite/64-workers-4                41.00µ ±  34%      42.10µ ±  18%       ~ (p=0.596 n=7)
Update/dqlite/128-workers-4               45.50µ ±  24%      43.00µ ±  22%       ~ (p=0.477 n=7)
geomean                                                 ²                   -2.06%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                After                 │
                                        │      B/op      │      B/op       vs base              │
Compaction/sqlite-4                          840.0 ± 26%     820.0 ±  52%       ~ (p=0.902 n=7)
Compaction/dqlite-4                        5.250Ki ± 23%   4.068Ki ±  46%       ~ (p=0.053 n=7)
Create/sqlite/1-workers-4                  20.68Ki ±  0%   20.71Ki ±   0%  +0.13% (p=0.029 n=7)
Create/sqlite/4-workers-4                  20.67Ki ±  6%   20.73Ki ±   1%       ~ (p=0.165 n=7)
Create/sqlite/16-workers-4                 20.80Ki ± 10%   20.82Ki ±  11%       ~ (p=0.734 n=7)
Create/sqlite/64-workers-4                 22.64Ki ±  9%   22.03Ki ±   5%       ~ (p=0.128 n=7)
Create/sqlite/128-workers-4                22.74Ki ±  6%   23.22Ki ±   5%       ~ (p=0.259 n=7)
Create/dqlite/1-workers-4                  19.44Ki ±  0%   19.43Ki ±   0%       ~ (p=0.175 n=7)
Create/dqlite/4-workers-4                  19.45Ki ±  0%   19.45Ki ±   0%       ~ (p=0.737 n=7)
Create/dqlite/16-workers-4                 19.42Ki ±  0%   19.42Ki ±   0%       ~ (p=0.515 n=7)
Create/dqlite/64-workers-4                 19.47Ki ±  0%   19.47Ki ±   0%       ~ (p=0.738 n=7)
Create/dqlite/128-workers-4                19.49Ki ±  0%   19.46Ki ±   0%       ~ (p=0.365 n=7)
Delete/sqlite/1-workers-4                  22.72Ki ± 12%   22.92Ki ±   4%       ~ (p=0.456 n=7)
Delete/sqlite/4-workers-4                  22.98Ki ± 11%   22.57Ki ±   7%       ~ (p=0.710 n=7)
Delete/sqlite/16-workers-4                 23.16Ki ± 11%   22.49Ki ±   6%       ~ (p=0.364 n=7)
Delete/sqlite/64-workers-4                 24.68Ki ±  5%   24.01Ki ±   5%       ~ (p=0.318 n=7)
Delete/sqlite/128-workers-4                25.49Ki ±  4%   26.01Ki ±   7%       ~ (p=0.535 n=7)
Delete/dqlite/1-workers-4                  21.70Ki ±  0%   21.69Ki ±   0%       ~ (p=0.597 n=7)
Delete/dqlite/4-workers-4                  21.67Ki ±  0%   21.67Ki ±   0%       ~ (p=0.468 n=7)
Delete/dqlite/16-workers-4                 21.69Ki ±  0%   21.67Ki ±   0%       ~ (p=0.805 n=7)
Delete/dqlite/64-workers-4                 21.68Ki ±  0%   21.73Ki ±   0%       ~ (p=0.120 n=7)
Delete/dqlite/128-workers-4                21.71Ki ±  0%   21.71Ki ±   0%       ~ (p=0.966 n=7)
Get/sqlite-4                               25.00Ki ±  0%   24.99Ki ±   0%       ~ (p=0.689 n=7)
Get/dqlite-4                               22.81Ki ±  0%   22.81Ki ±   0%       ~ (p=0.941 n=7)
List/sqlite-tiny/all-4                     1.257Ki ±  2%   1.249Ki ±   3%       ~ (p=0.558 n=7)
List/sqlite-tiny/pagination-4              1.792Ki ±  5%   1.781Ki ±   4%       ~ (p=0.535 n=7)
List/sqlite-fits-in-page/all-4             5.138Ki ±  1%   5.107Ki ±   3%       ~ (p=0.383 n=7)
List/sqlite-fits-in-page/pagination-4      10.20Ki ±  0%   10.23Ki ±   0%       ~ (p=0.596 n=7)
List/sqlite-overflows-page/all-4           26.30Ki ±  6%   26.02Ki ±   5%       ~ (p=0.902 n=7)
List/sqlite-overflows-page/pagination-4    46.15Ki ±  1%   46.12Ki ±   0%       ~ (p=0.259 n=7)
List/dqlite-tiny/all-4                       871.0 ±  5%     871.0 ±   9%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4                842.0 ±  1%     845.0 ±   4%       ~ (p=0.197 n=7)
List/dqlite-fits-in-page/all-4             4.294Ki ±  2%   4.285Ki ±   2%       ~ (p=0.557 n=7)
List/dqlite-fits-in-page/pagination-4      4.328Ki ±  1%   4.309Ki ±   5%       ~ (p=0.318 n=7)
List/dqlite-overflows-page/all-4           21.07Ki ±  1%   21.04Ki ±   1%       ~ (p=0.535 n=7)
List/dqlite-overflows-page/pagination-4    22.91Ki ±  4%   22.68Ki ±   4%       ~ (p=0.318 n=7)
Update/sqlite/1-workers-4                  22.49Ki ±  0%   22.48Ki ±   0%       ~ (p=0.476 n=7)
Update/sqlite/4-workers-4                  22.56Ki ±  0%   22.44Ki ±   1%       ~ (p=0.209 n=7)
Update/sqlite/16-workers-4                 22.66Ki ±  2%   22.78Ki ±   2%       ~ (p=0.558 n=7)
Update/sqlite/64-workers-4                1449.4Ki ± 74%   774.8Ki ± 105%       ~ (p=0.902 n=7)
Update/sqlite/128-workers-4                2.806Mi ±  6%   2.775Mi ±   5%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                  21.14Ki ±  0%   21.14Ki ±   0%       ~ (p=0.557 n=7)
Update/dqlite/4-workers-4                  21.17Ki ±  0%   21.17Ki ±   0%       ~ (p=0.600 n=7)
Update/dqlite/16-workers-4                 21.26Ki ±  1%   21.26Ki ±   1%       ~ (p=0.805 n=7)
Update/dqlite/64-workers-4                 21.33Ki ±  3%   21.59Ki ±   2%       ~ (p=0.209 n=7)
Update/dqlite/128-workers-4                22.05Ki ±  4%   22.37Ki ±   5%       ~ (p=0.710 n=7)
geomean                                    16.78Ki         16.43Ki         -2.11%

                                        │    Before    │                 After                 │
                                        │  allocs/op   │   allocs/op    vs base                │
Compaction/sqlite-4                        32.00 ± 28%    31.00 ±  58%       ~ (p=0.825 n=7)
Compaction/dqlite-4                       127.00 ± 24%    98.00 ±  47%       ~ (p=0.053 n=7)
Create/sqlite/1-workers-4                  444.0 ±  0%    444.0 ±   0%       ~ (p=0.437 n=7)
Create/sqlite/4-workers-4                  443.0 ±  8%    444.0 ±   1%       ~ (p=0.324 n=7)
Create/sqlite/16-workers-4                 445.0 ± 15%    444.0 ±  15%       ~ (p=0.318 n=7)
Create/sqlite/64-workers-4                 456.0 ±  7%    419.0 ±  11%  -8.11% (p=0.026 n=7)
Create/sqlite/128-workers-4                443.0 ±  8%    460.0 ±   8%       ~ (p=0.076 n=7)
Create/dqlite/1-workers-4                  361.0 ±  0%    361.0 ±   0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                  361.0 ±  0%    361.0 ±   0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                 361.0 ±  0%    361.0 ±   0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                 361.0 ±  0%    361.0 ±   0%       ~ (p=1.000 n=7)
Create/dqlite/128-workers-4                360.0 ±  0%    360.0 ±   0%       ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                  492.0 ± 16%    497.0 ±   6%       ~ (p=0.436 n=7)
Delete/sqlite/4-workers-4                  499.0 ± 15%    486.0 ±  10%       ~ (p=0.647 n=7)
Delete/sqlite/16-workers-4                 503.0 ± 16%    480.0 ±   8%       ~ (p=0.364 n=7)
Delete/sqlite/64-workers-4                 497.0 ±  7%    489.0 ±   8%       ~ (p=0.318 n=7)
Delete/sqlite/128-workers-4                512.0 ±  5%    527.0 ±  11%       ~ (p=0.598 n=7)
Delete/dqlite/1-workers-4                  391.0 ±  0%    391.0 ±   0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                  391.0 ±  0%    391.0 ±   0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                 391.0 ±  0%    391.0 ±   0%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                 391.0 ±  0%    391.0 ±   0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                391.0 ±  0%    391.0 ±   0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                               560.0 ±  0%    560.0 ±   0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               404.0 ±  0%    404.0 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     41.00 ±  2%    41.00 ±   2%       ~ (p=1.000 n=7)
List/sqlite-tiny/pagination-4              62.00 ±  5%    61.00 ±   5%       ~ (p=0.564 n=7)
List/sqlite-fits-in-page/all-4             47.00 ±  2%    47.00 ±   4%       ~ (p=0.371 n=7)
List/sqlite-fits-in-page/pagination-4      93.00 ±  0%    93.00 ±   0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           56.00 ±  5%    56.00 ±   4%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4    93.00 ±  0%    93.00 ±   0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     14.00 ±  7%    14.00 ±  14%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4              13.00 ±  0%    13.00 ±   8%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4             18.00 ±  6%    18.00 ±   6%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/pagination-4      18.00 ±  6%    17.00 ±  12%       ~ (p=0.266 n=7)
List/dqlite-overflows-page/all-4           29.00 ±  3%    29.00 ±   0%       ~ (p=1.000 n=7)
List/dqlite-overflows-page/pagination-4    33.00 ±  6%    32.00 ±   6%       ~ (p=0.307 n=7)
Update/sqlite/1-workers-4                  460.0 ±  0%    460.0 ±   1%       ~ (p=0.731 n=7)
Update/sqlite/4-workers-4                  461.0 ±  0%    454.0 ±   2%       ~ (p=0.110 n=7)
Update/sqlite/16-workers-4                 460.0 ±  2%    464.0 ±   2%       ~ (p=0.512 n=7)
Update/sqlite/64-workers-4                26.98k ± 73%   15.00k ± 107%       ~ (p=0.805 n=7)
Update/sqlite/128-workers-4               57.60k ± 10%   56.28k ±  10%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                  373.0 ±  0%    373.0 ±   0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                  374.0 ±  0%    374.0 ±   0%       ~ (p=1.000 n=7)
Update/dqlite/16-workers-4                 375.0 ±  1%    375.0 ±   1%       ~ (p=0.607 n=7)
Update/dqlite/64-workers-4                 377.0 ±  3%    380.0 ±   2%       ~ (p=0.307 n=7)
Update/dqlite/128-workers-4                389.0 ±  4%    394.0 ±   5%       ~ (p=0.645 n=7)
geomean                                    246.6          240.9         -2.34%
¹ all samples are equal

                                        │        Before         │                    After                    │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base              │
Compaction/dqlite-4                               1.913Ki ± 24%           1.473Ki ± 47%       ~ (p=0.053 n=7)
Create/dqlite/1-workers-4                           241.4 ±  0%             241.6 ±  0%       ~ (p=0.361 n=7)
Create/dqlite/4-workers-4                           242.5 ±  0%             242.5 ±  0%       ~ (p=0.828 n=7)
Create/dqlite/16-workers-4                          242.3 ±  0%             242.3 ±  0%       ~ (p=0.337 n=7)
Create/dqlite/64-workers-4                          242.4 ±  0%             242.6 ±  0%  +0.08% (p=0.008 n=7)
Create/dqlite/128-workers-4                         242.4 ±  0%             242.3 ±  0%       ~ (p=0.162 n=7)
Delete/dqlite/1-workers-4                           718.6 ±  0%             718.4 ±  0%       ~ (p=0.972 n=7)
Delete/dqlite/4-workers-4                           720.1 ±  0%             720.2 ±  0%       ~ (p=0.151 n=7)
Delete/dqlite/16-workers-4                          720.1 ±  0%             720.2 ±  0%       ~ (p=0.609 n=7)
Delete/dqlite/64-workers-4                          720.1 ±  0%             720.5 ±  0%       ~ (p=0.285 n=7)
Delete/dqlite/128-workers-4                         720.4 ±  0%             720.3 ±  0%       ~ (p=0.484 n=7)
Get/dqlite-4                                      1.132Ki ±  0%           1.132Ki ±  0%       ~ (p=0.538 n=7)
List/dqlite-tiny/all-4                              202.3 ±  8%             203.5 ± 14%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4                       191.1 ±  2%             192.4 ±  2%       ~ (p=0.128 n=7)
List/dqlite-fits-in-page/all-4                    1.229Ki ±  3%           1.228Ki ±  3%       ~ (p=0.804 n=7)
List/dqlite-fits-in-page/pagination-4             1.225Ki ±  3%           1.206Ki ±  8%       ~ (p=0.364 n=7)
List/dqlite-overflows-page/all-4                  6.157Ki ±  2%           6.151Ki ±  1%       ~ (p=0.557 n=7)
List/dqlite-overflows-page/pagination-4           6.918Ki ±  7%           6.807Ki ±  6%       ~ (p=0.477 n=7)
Update/dqlite/1-workers-4                           262.9 ±  0%             262.9 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/4-workers-4                           263.3 ±  0%             263.4 ±  0%       ~ (p=0.742 n=7)
Update/dqlite/16-workers-4                          264.3 ±  1%             264.2 ±  1%       ~ (p=0.474 n=7)
Update/dqlite/64-workers-4                          265.0 ±  3%             267.7 ±  2%       ~ (p=0.245 n=7)
Update/dqlite/128-workers-4                         274.1 ±  4%             277.4 ±  5%       ~ (p=0.710 n=7)
geomean                                             555.2                   549.0        -1.12%

                                        │          Before          │                     After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base              │
Compaction/dqlite-4                                    4.544 ±  4%                4.357 ±  7%  -4.12% (p=0.038 n=7)
Create/dqlite/1-workers-4                              115.8 ±  1%                116.2 ±  1%       ~ (p=0.425 n=7)
Create/dqlite/4-workers-4                              118.0 ±  0%                118.0 ±  1%       ~ (p=0.927 n=7)
Create/dqlite/16-workers-4                             117.6 ±  1%                117.6 ±  1%       ~ (p=0.749 n=7)
Create/dqlite/64-workers-4                             118.0 ±  1%                118.1 ±  1%  +0.08% (p=0.022 n=7)
Create/dqlite/128-workers-4                            117.7 ±  0%                117.5 ±  0%       ~ (p=0.197 n=7)
Delete/dqlite/1-workers-4                              82.79 ±  1%                82.72 ±  0%       ~ (p=1.000 n=7)
Delete/dqlite/4-workers-4                              83.33 ±  0%                83.41 ±  0%       ~ (p=0.363 n=7)
Delete/dqlite/16-workers-4                             83.45 ±  0%                83.49 ±  0%       ~ (p=0.902 n=7)
Delete/dqlite/64-workers-4                             83.45 ±  0%                83.61 ±  0%       ~ (p=0.473 n=7)
Delete/dqlite/128-workers-4                            83.48 ±  0%                83.49 ±  0%       ~ (p=1.000 n=7)
Get/dqlite-4                                           80.57 ±  0%                80.51 ±  0%       ~ (p=0.495 n=7)
List/dqlite-tiny/all-4                               0.04262 ± 15%              0.04314 ± 28%       ~ (p=0.805 n=7)
List/dqlite-tiny/pagination-4                        0.04622 ±  6%              0.04804 ±  6%       ~ (p=0.535 n=7)
List/dqlite-fits-in-page/all-4                       0.05193 ±  4%              0.05213 ±  4%       ~ (p=0.710 n=7)
List/dqlite-fits-in-page/pagination-4                0.07509 ± 10%              0.07091 ± 10%       ~ (p=0.073 n=7)
List/dqlite-overflows-page/all-4                     0.06282 ±  2%              0.06308 ±  3%       ~ (p=1.000 n=7)
List/dqlite-overflows-page/pagination-4               0.1107 ± 11%               0.1118 ± 27%       ~ (p=0.736 n=7)
Update/dqlite/1-workers-4                              136.6 ±  0%                136.7 ±  0%       ~ (p=0.633 n=7)
Update/dqlite/4-workers-4                              136.6 ±  0%                136.7 ±  0%       ~ (p=0.208 n=7)
Update/dqlite/16-workers-4                             137.4 ±  1%                137.2 ±  1%       ~ (p=0.827 n=7)
Update/dqlite/64-workers-4                             138.0 ±  3%                139.2 ±  2%       ~ (p=0.318 n=7)
Update/dqlite/128-workers-4                            142.4 ±  4%                144.2 ±  5%       ~ (p=0.620 n=7)
geomean                                                13.43                      13.43        -0.02%

Current status

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │     After     │
                                        │    sec/op     │
Compaction/sqlite-4                       35.45µ ±  14%
Compaction/dqlite-4                       39.39µ ±   7%
Create/sqlite/1-workers-4                 1.058m ±   5%
Create/sqlite/4-workers-4                 1.167m ±  10%
Create/sqlite/16-workers-4                1.455m ±  20%
Create/sqlite/64-workers-4                15.51m ±  31%
Create/sqlite/128-workers-4               16.73m ± 167%
Create/dqlite/1-workers-4                 931.5µ ±   7%
Create/dqlite/4-workers-4                 815.7µ ±   5%
Create/dqlite/16-workers-4                830.7µ ±   3%
Create/dqlite/64-workers-4                836.1µ ±   2%
Create/dqlite/128-workers-4               849.6µ ±   2%
Delete/sqlite/1-workers-4                 1.093m ±   2%
Delete/sqlite/4-workers-4                 1.177m ±   5%
Delete/sqlite/16-workers-4                1.703m ±  18%
Delete/sqlite/64-workers-4                11.85m ±  89%
Delete/sqlite/128-workers-4               18.85m ± 131%
Delete/dqlite/1-workers-4                 951.3µ ±   6%
Delete/dqlite/4-workers-4                 845.8µ ±   3%
Delete/dqlite/16-workers-4                833.0µ ±   3%
Delete/dqlite/64-workers-4                849.4µ ±   4%
Delete/dqlite/128-workers-4               854.3µ ±   4%
Get/sqlite-4                              270.6µ ±   1%
Get/dqlite-4                              359.5µ ±   1%
List/sqlite-tiny/all-4                    4.413µ ±   3%
List/sqlite-tiny/pagination-4             8.750µ ±   3%
List/sqlite-fits-in-page/all-4            7.076µ ±   2%
List/sqlite-fits-in-page/pagination-4     22.03µ ±   3%
List/sqlite-overflows-page/all-4          17.47µ ±   6%
List/sqlite-overflows-page/pagination-4   45.48µ ±   4%
List/dqlite-tiny/all-4                    2.846µ ±   9%
List/dqlite-tiny/pagination-4             5.937µ ±   2%
List/dqlite-fits-in-page/all-4            5.931µ ±   2%
List/dqlite-fits-in-page/pagination-4     15.90µ ±   3%
List/dqlite-overflows-page/all-4          17.98µ ±   3%
List/dqlite-overflows-page/pagination-4   39.79µ ±   7%
Update/sqlite/1-workers-4                 1.070m ±   4%
Update/sqlite/4-workers-4                 1.172m ±  18%
Update/sqlite/16-workers-4                1.431m ±  19%
Update/sqlite/64-workers-4                 1.145 ± 149%
Update/sqlite/128-workers-4                2.794 ±  37%
Update/dqlite/1-workers-4                 943.5µ ±   2%
Update/dqlite/4-workers-4                 835.2µ ±   7%
Update/dqlite/16-workers-4                808.2µ ±   3%
Update/dqlite/64-workers-4                838.4µ ±   4%
Update/dqlite/128-workers-4               873.1µ ±   5%
geomean                                   448.8µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                        12.21 ±   1%
Compaction/dqlite-4                        12.18 ±   2%
Create/sqlite/1-workers-4                  14.33 ±   1%
Create/sqlite/4-workers-4                  13.89 ±   4%
Create/sqlite/16-workers-4                 12.73 ±  12%
Create/sqlite/64-workers-4                 5.190 ±   7%
Create/sqlite/128-workers-4                4.880 ±  16%
Create/dqlite/1-workers-4                  13.34 ±   1%
Create/dqlite/4-workers-4                  10.87 ±   2%
Create/dqlite/16-workers-4                 10.93 ±   1%
Create/dqlite/64-workers-4                 10.96 ±   1%
Create/dqlite/128-workers-4                10.96 ±   1%
Delete/sqlite/1-workers-4                  16.73 ±   5%
Delete/sqlite/4-workers-4                  15.91 ±   8%
Delete/sqlite/16-workers-4                 14.81 ±   8%
Delete/sqlite/64-workers-4                 7.890 ±  27%
Delete/sqlite/128-workers-4                6.200 ±   8%
Delete/dqlite/1-workers-4                  15.63 ±   2%
Delete/dqlite/4-workers-4                  13.18 ±   1%
Delete/dqlite/16-workers-4                 13.20 ±   1%
Delete/dqlite/64-workers-4                 13.24 ±   1%
Delete/dqlite/128-workers-4                13.18 ±   1%
Get/sqlite-4                               14.96 ±   0%
Get/dqlite-4                               11.95 ±   0%
List/sqlite-tiny/all-4                    192.2m ±   0%
List/sqlite-tiny/pagination-4              1.132 ±   3%
List/sqlite-fits-in-page/all-4            164.9m ±   0%
List/sqlite-fits-in-page/pagination-4     965.6m ±   0%
List/sqlite-overflows-page/all-4          262.3m ±  20%
List/sqlite-overflows-page/pagination-4    2.080 ±   2%
List/dqlite-tiny/all-4                    191.2m ±   1%
List/dqlite-tiny/pagination-4              1.126 ±   3%
List/dqlite-fits-in-page/all-4            163.1m ±   0%
List/dqlite-fits-in-page/pagination-4     954.2m ±   3%
List/dqlite-overflows-page/all-4          182.7m ±   0%
List/dqlite-overflows-page/pagination-4    1.070 ±   3%
Update/sqlite/1-workers-4                  16.40 ±   0%
Update/sqlite/4-workers-4                  15.87 ±   1%
Update/sqlite/16-workers-4                 15.33 ±   3%
Update/sqlite/64-workers-4                 158.0 ± 111%
Update/sqlite/128-workers-4                602.0 ±  12%
Update/dqlite/1-workers-4                  15.41 ±   1%
Update/dqlite/4-workers-4                  12.69 ±   1%
Update/dqlite/16-workers-4                 12.70 ±   1%
Update/dqlite/64-workers-4                 12.86 ±   3%
Update/dqlite/128-workers-4                13.28 ±   4%
geomean                                    5.993

                                        │      After      │
                                        │ page-writes/op  │
Compaction/sqlite-4                       207.9m ±   1%
Compaction/dqlite-4                       187.4m ±   1%
Create/sqlite/1-workers-4                  5.224 ±   1%
Create/sqlite/4-workers-4                  5.154 ±   1%
Create/sqlite/16-workers-4                 5.105 ±   0%
Create/sqlite/64-workers-4                 5.000 ±   0%
Create/sqlite/128-workers-4                5.000 ±   0%
Create/dqlite/1-workers-4                  4.284 ±   1%
Create/dqlite/4-workers-4                  4.314 ±   0%
Create/dqlite/16-workers-4                 4.312 ±   0%
Create/dqlite/64-workers-4                 4.313 ±   0%
Create/dqlite/128-workers-4                4.305 ±   0%
Delete/sqlite/1-workers-4                  5.305 ±   1%
Delete/sqlite/4-workers-4                  5.292 ±   1%
Delete/sqlite/16-workers-4                 5.282 ±   1%
Delete/sqlite/64-workers-4                 5.070 ±   2%
Delete/sqlite/128-workers-4                5.070 ±   0%
Delete/dqlite/1-workers-4                  4.361 ±   1%
Delete/dqlite/4-workers-4                  4.376 ±   0%
Delete/dqlite/16-workers-4                 4.380 ±   0%
Delete/dqlite/64-workers-4                 4.363 ±   1%
Delete/dqlite/128-workers-4                4.353 ±   1%
Get/sqlite-4                               0.000 ±   0%
Get/dqlite-4                               0.000 ±   0%
List/sqlite-tiny/all-4                     0.000 ±   0%
List/sqlite-tiny/pagination-4              0.000 ±   0%
List/sqlite-fits-in-page/all-4             0.000 ±   0%
List/sqlite-fits-in-page/pagination-4      0.000 ±   0%
List/sqlite-overflows-page/all-4           0.000 ±   0%
List/sqlite-overflows-page/pagination-4    0.000 ±   0%
List/dqlite-tiny/all-4                     0.000 ±   0%
List/dqlite-tiny/pagination-4              0.000 ±   0%
List/dqlite-fits-in-page/all-4             0.000 ±   0%
List/dqlite-fits-in-page/pagination-4      0.000 ±   0%
List/dqlite-overflows-page/all-4           0.000 ±   0%
List/dqlite-overflows-page/pagination-4    0.000 ±   0%
Update/sqlite/1-workers-4                  5.194 ±   0%
Update/sqlite/4-workers-4                  5.209 ±   1%
Update/sqlite/16-workers-4                 5.237 ±   1%
Update/sqlite/64-workers-4                 160.0 ± 100%
Update/sqlite/128-workers-4                642.0 ±   0%
Update/dqlite/1-workers-4                  4.217 ±   0%
Update/dqlite/4-workers-4                  4.225 ±   1%
Update/dqlite/16-workers-4                 4.232 ±   1%
Update/dqlite/64-workers-4                 4.343 ±   3%
Update/dqlite/128-workers-4                4.472 ±   3%
geomean                                                 ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                       112.1µ ±   15%
Compaction/dqlite-4                       24.20µ ±   31%
Create/sqlite/1-workers-4                 42.50µ ±  853%
Create/sqlite/4-workers-4                 42.10µ ±   85%
Create/sqlite/16-workers-4                48.40µ ± 1589%
Create/sqlite/64-workers-4                460.0µ ±  624%
Create/sqlite/128-workers-4               1.330m ±  450%
Create/dqlite/1-workers-4                 11.20µ ±   52%
Create/dqlite/4-workers-4                 11.50µ ±   50%
Create/dqlite/16-workers-4                11.80µ ±   39%
Create/dqlite/64-workers-4                11.60µ ±   35%
Create/dqlite/128-workers-4               10.80µ ±   48%
Delete/sqlite/1-workers-4                 218.2µ ±  136%
Delete/sqlite/4-workers-4                 319.3µ ±  164%
Delete/sqlite/16-workers-4                481.9µ ±  127%
Delete/sqlite/64-workers-4                1.080m ±  225%
Delete/sqlite/128-workers-4               2.600m ±  219%
Delete/dqlite/1-workers-4                 15.20µ ±   44%
Delete/dqlite/4-workers-4                 17.10µ ±   41%
Delete/dqlite/16-workers-4                17.00µ ±   28%
Delete/dqlite/64-workers-4                14.70µ ±   31%
Delete/dqlite/128-workers-4               18.10µ ±   22%
Get/sqlite-4                              90.20µ ±    3%
Get/dqlite-4                              34.10µ ±   17%
List/sqlite-tiny/all-4                    14.10µ ±    4%
List/sqlite-tiny/pagination-4             18.70µ ±    4%
List/sqlite-fits-in-page/all-4            16.60µ ±  173%
List/sqlite-fits-in-page/pagination-4     58.10µ ±    3%
List/sqlite-overflows-page/all-4          54.00µ ±   17%
List/sqlite-overflows-page/pagination-4   167.8µ ±    2%
List/dqlite-tiny/all-4                    4.000µ ±   22%
List/dqlite-tiny/pagination-4             9.300µ ±   18%
List/dqlite-fits-in-page/all-4            10.00µ ±   17%
List/dqlite-fits-in-page/pagination-4     24.70µ ±   14%
List/dqlite-overflows-page/all-4          31.30µ ±    2%
List/dqlite-overflows-page/pagination-4   67.00µ ±   12%
Update/sqlite/1-workers-4                 45.90µ ±  181%
Update/sqlite/4-workers-4                 43.90µ ±  667%
Update/sqlite/16-workers-4                33.50µ ±  886%
Update/sqlite/64-workers-4                11.00m ±  482%
Update/sqlite/128-workers-4               338.0m ±  561%
Update/dqlite/1-workers-4                 9.700µ ±   45%
Update/dqlite/4-workers-4                 10.40µ ±   48%
Update/dqlite/16-workers-4                11.00µ ±   38%
Update/dqlite/64-workers-4                11.20µ ±   27%
Update/dqlite/128-workers-4               8.600µ ±  103%
geomean                                   52.29µ

                                        │      After      │
                                        │ sec-writing/op  │
Compaction/sqlite-4                       10.10µ ±  11%
Compaction/dqlite-4                       6.900µ ±   9%
Create/sqlite/1-workers-4                 819.4µ ±   5%
Create/sqlite/4-workers-4                 3.233m ±  10%
Create/sqlite/16-workers-4                12.92m ±  29%
Create/sqlite/64-workers-4                166.4m ±  55%
Create/sqlite/128-workers-4               307.5m ± 375%
Create/dqlite/1-workers-4                 36.40µ ±  30%
Create/dqlite/4-workers-4                 41.70µ ±  34%
Create/dqlite/16-workers-4                38.30µ ±  19%
Create/dqlite/64-workers-4                39.90µ ±  19%
Create/dqlite/128-workers-4               45.50µ ±  20%
Delete/sqlite/1-workers-4                 865.1µ ±   3%
Delete/sqlite/4-workers-4                 3.171m ±  23%
Delete/sqlite/16-workers-4                13.73m ±  21%
Delete/sqlite/64-workers-4                180.4m ±  80%
Delete/sqlite/128-workers-4               371.0m ± 203%
Delete/dqlite/1-workers-4                 37.20µ ±  27%
Delete/dqlite/4-workers-4                 42.40µ ±  26%
Delete/dqlite/16-workers-4                42.50µ ±  11%
Delete/dqlite/64-workers-4                43.10µ ±  18%
Delete/dqlite/128-workers-4               42.00µ ±  11%
Get/sqlite-4                               0.000 ±   0%
Get/dqlite-4                               0.000 ±   0%
List/sqlite-tiny/all-4                     0.000 ±   0%
List/sqlite-tiny/pagination-4              0.000 ±   0%
List/sqlite-fits-in-page/all-4             0.000 ±   0%
List/sqlite-fits-in-page/pagination-4      0.000 ±   0%
List/sqlite-overflows-page/all-4           0.000 ±   0%
List/sqlite-overflows-page/pagination-4    0.000 ±   0%
List/dqlite-tiny/all-4                     0.000 ±   0%
List/dqlite-tiny/pagination-4              0.000 ±   0%
List/dqlite-fits-in-page/all-4             0.000 ±   0%
List/dqlite-fits-in-page/pagination-4      0.000 ±   0%
List/dqlite-overflows-page/all-4           0.000 ±   0%
List/dqlite-overflows-page/pagination-4    0.000 ±   0%
Update/sqlite/1-workers-4                 818.4µ ±   7%
Update/sqlite/4-workers-4                 3.252m ±  23%
Update/sqlite/16-workers-4                12.42m ±  18%
Update/sqlite/64-workers-4                 12.71 ± 208%
Update/sqlite/128-workers-4                80.68 ±  36%
Update/dqlite/1-workers-4                 34.40µ ±  40%
Update/dqlite/4-workers-4                 39.10µ ±  12%
Update/dqlite/16-workers-4                41.60µ ±  21%
Update/dqlite/64-workers-4                42.10µ ±  18%
Update/dqlite/128-workers-4               43.00µ ±  22%
geomean                                                 ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │      B/op      │
Compaction/sqlite-4                         820.0 ±  52%
Compaction/dqlite-4                       4.068Ki ±  46%
Create/sqlite/1-workers-4                 20.71Ki ±   0%
Create/sqlite/4-workers-4                 20.73Ki ±   1%
Create/sqlite/16-workers-4                20.82Ki ±  11%
Create/sqlite/64-workers-4                22.03Ki ±   5%
Create/sqlite/128-workers-4               23.22Ki ±   5%
Create/dqlite/1-workers-4                 19.43Ki ±   0%
Create/dqlite/4-workers-4                 19.45Ki ±   0%
Create/dqlite/16-workers-4                19.42Ki ±   0%
Create/dqlite/64-workers-4                19.47Ki ±   0%
Create/dqlite/128-workers-4               19.46Ki ±   0%
Delete/sqlite/1-workers-4                 22.92Ki ±   4%
Delete/sqlite/4-workers-4                 22.57Ki ±   7%
Delete/sqlite/16-workers-4                22.49Ki ±   6%
Delete/sqlite/64-workers-4                24.01Ki ±   5%
Delete/sqlite/128-workers-4               26.01Ki ±   7%
Delete/dqlite/1-workers-4                 21.69Ki ±   0%
Delete/dqlite/4-workers-4                 21.67Ki ±   0%
Delete/dqlite/16-workers-4                21.67Ki ±   0%
Delete/dqlite/64-workers-4                21.73Ki ±   0%
Delete/dqlite/128-workers-4               21.71Ki ±   0%
Get/sqlite-4                              24.99Ki ±   0%
Get/dqlite-4                              22.81Ki ±   0%
List/sqlite-tiny/all-4                    1.249Ki ±   3%
List/sqlite-tiny/pagination-4             1.781Ki ±   4%
List/sqlite-fits-in-page/all-4            5.107Ki ±   3%
List/sqlite-fits-in-page/pagination-4     10.23Ki ±   0%
List/sqlite-overflows-page/all-4          26.02Ki ±   5%
List/sqlite-overflows-page/pagination-4   46.12Ki ±   0%
List/dqlite-tiny/all-4                      871.0 ±   9%
List/dqlite-tiny/pagination-4               845.0 ±   4%
List/dqlite-fits-in-page/all-4            4.285Ki ±   2%
List/dqlite-fits-in-page/pagination-4     4.309Ki ±   5%
List/dqlite-overflows-page/all-4          21.04Ki ±   1%
List/dqlite-overflows-page/pagination-4   22.68Ki ±   4%
Update/sqlite/1-workers-4                 22.48Ki ±   0%
Update/sqlite/4-workers-4                 22.44Ki ±   1%
Update/sqlite/16-workers-4                22.78Ki ±   2%
Update/sqlite/64-workers-4                774.8Ki ± 105%
Update/sqlite/128-workers-4               2.775Mi ±   5%
Update/dqlite/1-workers-4                 21.14Ki ±   0%
Update/dqlite/4-workers-4                 21.17Ki ±   0%
Update/dqlite/16-workers-4                21.26Ki ±   1%
Update/dqlite/64-workers-4                21.59Ki ±   2%
Update/dqlite/128-workers-4               22.37Ki ±   5%
geomean                                   16.43Ki

                                        │     After     │
                                        │   allocs/op   │
Compaction/sqlite-4                        31.00 ±  58%
Compaction/dqlite-4                        98.00 ±  47%
Create/sqlite/1-workers-4                  444.0 ±   0%
Create/sqlite/4-workers-4                  444.0 ±   1%
Create/sqlite/16-workers-4                 444.0 ±  15%
Create/sqlite/64-workers-4                 419.0 ±  11%
Create/sqlite/128-workers-4                460.0 ±   8%
Create/dqlite/1-workers-4                  361.0 ±   0%
Create/dqlite/4-workers-4                  361.0 ±   0%
Create/dqlite/16-workers-4                 361.0 ±   0%
Create/dqlite/64-workers-4                 361.0 ±   0%
Create/dqlite/128-workers-4                360.0 ±   0%
Delete/sqlite/1-workers-4                  497.0 ±   6%
Delete/sqlite/4-workers-4                  486.0 ±  10%
Delete/sqlite/16-workers-4                 480.0 ±   8%
Delete/sqlite/64-workers-4                 489.0 ±   8%
Delete/sqlite/128-workers-4                527.0 ±  11%
Delete/dqlite/1-workers-4                  391.0 ±   0%
Delete/dqlite/4-workers-4                  391.0 ±   0%
Delete/dqlite/16-workers-4                 391.0 ±   0%
Delete/dqlite/64-workers-4                 391.0 ±   0%
Delete/dqlite/128-workers-4                391.0 ±   0%
Get/sqlite-4                               560.0 ±   0%
Get/dqlite-4                               404.0 ±   0%
List/sqlite-tiny/all-4                     41.00 ±   2%
List/sqlite-tiny/pagination-4              61.00 ±   5%
List/sqlite-fits-in-page/all-4             47.00 ±   4%
List/sqlite-fits-in-page/pagination-4      93.00 ±   0%
List/sqlite-overflows-page/all-4           56.00 ±   4%
List/sqlite-overflows-page/pagination-4    93.00 ±   0%
List/dqlite-tiny/all-4                     14.00 ±  14%
List/dqlite-tiny/pagination-4              13.00 ±   8%
List/dqlite-fits-in-page/all-4             18.00 ±   6%
List/dqlite-fits-in-page/pagination-4      17.00 ±  12%
List/dqlite-overflows-page/all-4           29.00 ±   0%
List/dqlite-overflows-page/pagination-4    32.00 ±   6%
Update/sqlite/1-workers-4                  460.0 ±   1%
Update/sqlite/4-workers-4                  454.0 ±   2%
Update/sqlite/16-workers-4                 464.0 ±   2%
Update/sqlite/64-workers-4                15.00k ± 107%
Update/sqlite/128-workers-4               56.28k ±  10%
Update/dqlite/1-workers-4                  373.0 ±   0%
Update/dqlite/4-workers-4                  374.0 ±   0%
Update/dqlite/16-workers-4                 375.0 ±   1%
Update/dqlite/64-workers-4                 380.0 ±   2%
Update/dqlite/128-workers-4                394.0 ±   5%
geomean                                    240.9

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               1.473Ki ± 47%
Create/dqlite/1-workers-4                           241.6 ±  0%
Create/dqlite/4-workers-4                           242.5 ±  0%
Create/dqlite/16-workers-4                          242.3 ±  0%
Create/dqlite/64-workers-4                          242.6 ±  0%
Create/dqlite/128-workers-4                         242.3 ±  0%
Delete/dqlite/1-workers-4                           718.4 ±  0%
Delete/dqlite/4-workers-4                           720.2 ±  0%
Delete/dqlite/16-workers-4                          720.2 ±  0%
Delete/dqlite/64-workers-4                          720.5 ±  0%
Delete/dqlite/128-workers-4                         720.3 ±  0%
Get/dqlite-4                                      1.132Ki ±  0%
List/dqlite-tiny/all-4                              203.5 ± 14%
List/dqlite-tiny/pagination-4                       192.4 ±  2%
List/dqlite-fits-in-page/all-4                    1.228Ki ±  3%
List/dqlite-fits-in-page/pagination-4             1.206Ki ±  8%
List/dqlite-overflows-page/all-4                  6.151Ki ±  1%
List/dqlite-overflows-page/pagination-4           6.807Ki ±  6%
Update/dqlite/1-workers-4                           262.9 ±  0%
Update/dqlite/4-workers-4                           263.4 ±  0%
Update/dqlite/16-workers-4                          264.2 ±  1%
Update/dqlite/64-workers-4                          267.7 ±  2%
Update/dqlite/128-workers-4                         277.4 ±  5%
geomean                                             549.0

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    4.357 ±  7%
Create/dqlite/1-workers-4                              116.2 ±  1%
Create/dqlite/4-workers-4                              118.0 ±  1%
Create/dqlite/16-workers-4                             117.6 ±  1%
Create/dqlite/64-workers-4                             118.1 ±  1%
Create/dqlite/128-workers-4                            117.5 ±  0%
Delete/dqlite/1-workers-4                              82.72 ±  0%
Delete/dqlite/4-workers-4                              83.41 ±  0%
Delete/dqlite/16-workers-4                             83.49 ±  0%
Delete/dqlite/64-workers-4                             83.61 ±  0%
Delete/dqlite/128-workers-4                            83.49 ±  0%
Get/dqlite-4                                           80.51 ±  0%
List/dqlite-tiny/all-4                               0.04314 ± 28%
List/dqlite-tiny/pagination-4                        0.04804 ±  6%
List/dqlite-fits-in-page/all-4                       0.05213 ±  4%
List/dqlite-fits-in-page/pagination-4                0.07091 ± 10%
List/dqlite-overflows-page/all-4                     0.06308 ±  3%
List/dqlite-overflows-page/pagination-4               0.1118 ± 27%
Update/dqlite/1-workers-4                              136.7 ±  0%
Update/dqlite/4-workers-4                              136.7 ±  0%
Update/dqlite/16-workers-4                             137.2 ±  1%
Update/dqlite/64-workers-4                             139.2 ±  2%
Update/dqlite/128-workers-4                            144.2 ±  5%
geomean                                                13.43

[HomayoonAlimohammadi]

LGTM! Thank you!

[bschimke95]

LGTM