Merge branch 'master' into dev

Beuth-Erdelt · Dec 20, 2024 · 6dcaf0a · 6dcaf0a
2 parents eaf41b1 + a01dd09
commit 6dcaf0a
Show file tree

Hide file tree

Showing 2 changed files with 368 additions and 0 deletions.
diff --git a/logs_tests/doc_ycsb_cockroachdb_2.log b/logs_tests/doc_ycsb_cockroachdb_2.log
@@ -0,0 +1,257 @@
+Data Directory                : is running
+Result Directory              : is running
+Dashboard                     : is running
+Message Queue                 : is running
+Experiment                    : has code 1730404688
+Experiment                    : starts at 2024-10-31 20:58:08.162731 (89489.569859888)
+Experiment                    : This experiment compares run time and resource consumption of YCSB queries.
+Workload is 'A'. Number of rows to insert is 1000000. Number of operations is 10000000. Batch size is ''.
+YCSB is performed using several threads and processes. Target is based on multiples of '16384'. Factors for loading are [4]. Factors for benchmarking are [4].
+System metrics are monitored by a cluster-wide installation.
+Benchmark is limited to DBMS ['CockroachDB'].
+Import is handled by 8 processes (pods).
+Loading is fixed to cl-worker19.
+Benchmarking is fixed to cl-worker19.
+SUT is fixed to cl-worker11.
+Loading is tested with [64] threads, split into [8] pods.
+Benchmarking is tested with [64] threads, split into [1] pods.
+Benchmarking is run as [1] times the number of benchmarking pods.
+Experiment is run once.
+Cluster monitoring            : is running
+Warning: spec.template.spec.containers[1].env[4]: hides previous definition of "BEXHOMA_WORKER_LIST"
+Warning: spec.template.spec.containers[0].env[2]: hides previous definition of "BEXHOMA_WORKER_FIRST"
+done
+CockroachDB-64-8-65536        : will start now
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is not loaded yet
+CockroachDB-64-8-65536        : will start loading but not before 2024-10-31 20:01:08 (that is in 120 secs)
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is not loaded yet
+CockroachDB-64-8-65536        : will start loading but not before 2024-10-31 20:01:08
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is not loaded yet
+CockroachDB-64-8-65536        : will start loading but not before 2024-10-31 20:01:08
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is not loaded yet
+CockroachDB-64-8-65536        : will start loading but not before 2024-10-31 20:01:08
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is not loaded yet
+done
+CockroachDB-64-8-65536 Workers 3 of 3
+CockroachDB-64-8-65536        : start asynch loading scripts of type loaded
+CockroachDB-64-8-65536        : is loading
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is loading
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is loading
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : is loading
+done
+CockroachDB-64-8-65536        : showing loader times
+CockroachDB-64-8-65536        : loader timespan (first to last [s]) = 84
+CockroachDB-64-8-65536        : benchmarks done 0 of 1. This will be client 1
+CockroachDB-64-8-65536        : we will change parameters of benchmark as {'PARALLEL': '1', 'SF': '1', 'BEXHOMA_SYNCH_LOAD': 1, 'YCSB_THREADCOUNT': 64, 'YCSB_TARGET': 65536, 'YCSB_STATUS': 1, 'YCSB_WORKLOAD': 'a', 'YCSB_ROWS': 1000000, 'YCSB_OPERATIONS': 10000000, 'YCSB_BATCHSIZE': ''}
+CockroachDB-64-8-65536-1      : start benchmarking
+CockroachDB-64-8-65536        : benchmarking results in folder /home/perdelt/benchmarks/1730404688
+- waiting 10s -               : done
+found
+CockroachDB-64-8-65536-1      : collecting loading metrics of SUT
+CockroachDB-64-8-65536-1      : collecting metrics of data generator
+CockroachDB-64-8-65536-1      : collecting metrics of data injector
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+- waiting 30s -               : done
+CockroachDB-64-8-65536        : has running benchmarks
+done
+CockroachDB-64-8-65536        : has running benchmarks
+CockroachDB-64-8-65536-1      : showing benchmarker times
+CockroachDB-64-8-65536-1      : benchmarker timespan (start to end single container [s]) = 841
+CockroachDB-64-8-65536-1      : benchmarker times (start/end per pod and container) = [(1730405012, 1730405835)]
+CockroachDB-64-8-65536-1      : found and updated times {'benchmarker': [(1730405012, 1730405835)]}
+CockroachDB-64-8-65536-1      : collecting execution metrics of SUT
+CockroachDB-64-8-65536-1      : collecting metrics of benchmarker
+done
+CockroachDB-64-8-65536        : can be stopped
+Experiment                    : ends at 2024-10-31 21:18:16.462565 (90697.869698848) - 1208.30s total
+Experiment                    : downloading partial results
+Experiment                    : uploading full results
+Experiment                    : uploading workload file
+Benchmarking                                           connection  ... [UPDATE].Return=OK
+connection_pod                                        ...                   
+CockroachDB-64-8-65536-1-1  CockroachDB-64-8-65536-1  ...            5003570
+
+[1 rows x 43 columns]
+Workflow {'CockroachDB-64-8-65536': [[1]]}
+Loading                                       connection  ... [INSERT].Return=OK
+connection_pod                                    ...                   
+CockroachDB-64-8-65536-1  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-2  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-3  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-4  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-5  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-6  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-7  CockroachDB-64-8-65536  ...             125000
+CockroachDB-64-8-65536-8  CockroachDB-64-8-65536  ...             125000
+
+[8 rows x 36 columns]
+Result workflow complete
+
+## Show Summary
+
+### Workload
+YCSB SF=1
+    Type: ycsb
+    Duration: 1209s 
+    Code: 1730404688
+    This includes no queries. YCSB runs the benchmark
+    This experiment compares run time and resource consumption of YCSB queries.
+    Workload is 'A'. Number of rows to insert is 1000000. Number of operations is 10000000. Batch size is ''.
+    YCSB is performed using several threads and processes. Target is based on multiples of '16384'. Factors for loading are [4]. Factors for benchmarking are [4].
+    System metrics are monitored by a cluster-wide installation.
+    Benchmark is limited to DBMS ['CockroachDB'].
+    Import is handled by 8 processes (pods).
+    Loading is fixed to cl-worker19.
+    Benchmarking is fixed to cl-worker19.
+    SUT is fixed to cl-worker11.
+    Loading is tested with [64] threads, split into [8] pods.
+    Benchmarking is tested with [64] threads, split into [1] pods.
+    Benchmarking is run as [1] times the number of benchmarking pods.
+    Experiment is run once.
+
+### Connections
+CockroachDB-64-8-65536-1 uses docker image cockroachdb/cockroach:v24.2.4
+    RAM:541008605184
+    Cores:64
+    host:5.15.0-116-generic
+    node:cl-worker11
+    disk:254913416
+    requests_cpu:4
+    requests_memory:16Gi
+    worker 0
+        RAM:1081966493696
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:256
+        host:5.15.0-1060-nvidia
+        node:cl-worker28
+        disk:684869688
+        datadisk:108191232
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+    worker 1
+        RAM:1081965535232
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:256
+        host:5.15.0-1060-nvidia
+        node:cl-worker27
+        disk:729321392
+        datadisk:107983636
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+    worker 2
+        RAM:1081750962176
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:128
+        host:5.15.0-122-generic
+        node:cl-worker29
+        disk:406572384
+        datadisk:107980308
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+
+### Loading
+                        experiment_run  threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [INSERT].Return=OK  [INSERT].99thPercentileLatency(us)
+CockroachDB-64-8-65536               1       64   65536          8                   12047.323421                83583.0             1000000                             17711.0
+
+### Execution
+                          experiment_run  threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [READ].Return=OK  [READ].99thPercentileLatency(us)  [UPDATE].Return=OK  [UPDATE].99thPercentileLatency(us)
+CockroachDB-64-8-65536-1               1       64   65536          1                        12148.6               823140.0           4996430                            7303.0             5003570                            163711.0
+
+### Workflow
+
+#### Actual
+DBMS CockroachDB-64-8-65536 - Pods [[1]]
+
+#### Planned
+DBMS CockroachDB-64-8-65536 - Pods [[1]]
+
+### Ingestion - SUT
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1     1495.11     8.35           4.2                 7.63
+
+### Ingestion - Loader
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1       91.09        0          4.29                 4.31
+
+### Execution - SUT
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1    21507.31    17.92          10.1                22.14
+
+### Execution - Benchmarker
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1     1184.95     1.48          0.61                 0.61
+
+### Tests
+TEST passed: [OVERALL].Throughput(ops/sec) contains no 0 or NaN
+TEST passed: [OVERALL].Throughput(ops/sec) contains no 0 or NaN
+TEST passed: Ingestion SUT contains no 0 or NaN in CPU [CPUs]
+TEST passed: Ingestion Loader contains no 0 or NaN in CPU [CPUs]
+TEST passed: Execution SUT contains no 0 or NaN in CPU [CPUs]
+TEST passed: Execution Benchmarker contains no 0 or NaN in CPU [CPUs]
+TEST passed: Workflow as planned
diff --git a/logs_tests/doc_ycsb_cockroachdb_2_summary.txt b/logs_tests/doc_ycsb_cockroachdb_2_summary.txt
@@ -0,0 +1,111 @@
+## Show Summary
+
+### Workload
+YCSB SF=1
+    Type: ycsb
+    Duration: 1209s 
+    Code: 1730404688
+    This includes no queries. YCSB runs the benchmark
+    This experiment compares run time and resource consumption of YCSB queries.
+    Workload is 'A'. Number of rows to insert is 1000000. Number of operations is 10000000. Batch size is ''.
+    YCSB is performed using several threads and processes. Target is based on multiples of '16384'. Factors for loading are [4]. Factors for benchmarking are [4].
+    System metrics are monitored by a cluster-wide installation.
+    Benchmark is limited to DBMS ['CockroachDB'].
+    Import is handled by 8 processes (pods).
+    Loading is fixed to cl-worker19.
+    Benchmarking is fixed to cl-worker19.
+    SUT is fixed to cl-worker11.
+    Loading is tested with [64] threads, split into [8] pods.
+    Benchmarking is tested with [64] threads, split into [1] pods.
+    Benchmarking is run as [1] times the number of benchmarking pods.
+    Experiment is run once.
+
+### Connections
+CockroachDB-64-8-65536-1 uses docker image cockroachdb/cockroach:v24.2.4
+    RAM:541008605184
+    Cores:64
+    host:5.15.0-116-generic
+    node:cl-worker11
+    disk:254913416
+    requests_cpu:4
+    requests_memory:16Gi
+    worker 0
+        RAM:1081966493696
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:256
+        host:5.15.0-1060-nvidia
+        node:cl-worker28
+        disk:684869688
+        datadisk:108191232
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+    worker 1
+        RAM:1081965535232
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:256
+        host:5.15.0-1060-nvidia
+        node:cl-worker27
+        disk:729321392
+        datadisk:107983636
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+    worker 2
+        RAM:1081750962176
+        CPU:
+        GPU:
+        GPUIDs:[]
+        Cores:128
+        host:5.15.0-122-generic
+        node:cl-worker29
+        disk:406572384
+        datadisk:107980308
+        volume_size:1000G
+        volume_used:101G
+        cuda:
+
+### Loading
+                        experiment_run  threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [INSERT].Return=OK  [INSERT].99thPercentileLatency(us)
+CockroachDB-64-8-65536               1       64   65536          8                   12047.323421                83583.0             1000000                             17711.0
+
+### Execution
+                          experiment_run  threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [READ].Return=OK  [READ].99thPercentileLatency(us)  [UPDATE].Return=OK  [UPDATE].99thPercentileLatency(us)
+CockroachDB-64-8-65536-1               1       64   65536          1                        12148.6               823140.0           4996430                            7303.0             5003570                            163711.0
+
+### Workflow
+
+#### Actual
+DBMS CockroachDB-64-8-65536 - Pods [[1]]
+
+#### Planned
+DBMS CockroachDB-64-8-65536 - Pods [[1]]
+
+### Ingestion - SUT
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1     1495.11     8.35           4.2                 7.63
+
+### Ingestion - Loader
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1       91.09        0          4.29                 4.31
+
+### Execution - SUT
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1    21507.31    17.92          10.1                22.14
+
+### Execution - Benchmarker
+                          CPU [CPUs]  Max CPU  Max RAM [Gb]  Max RAM Cached [Gb]
+CockroachDB-64-8-65536-1     1184.95     1.48          0.61                 0.61
+
+### Tests
+TEST passed: [OVERALL].Throughput(ops/sec) contains no 0 or NaN
+TEST passed: [OVERALL].Throughput(ops/sec) contains no 0 or NaN
+TEST passed: Ingestion SUT contains no 0 or NaN in CPU [CPUs]
+TEST passed: Ingestion Loader contains no 0 or NaN in CPU [CPUs]
+TEST passed: Execution SUT contains no 0 or NaN in CPU [CPUs]
+TEST passed: Execution Benchmarker contains no 0 or NaN in CPU [CPUs]
+TEST passed: Workflow as planned