Scaling Factor and Minor Bug Fixes

V0.5.3 (#79)

* Config: Current settings for K8s and JDBC

* Prepare next release

* Masterscript: Zip remote result folder typo

* Masterscript: Remove worker PV if not used

* Masterscript: Remove worker Service and StatefulSet if not used

* Masterscript: Catch memory exception

* Masterscript: field_selector in get pods

* Masterscript: mark config as done

* Masterscript: max_sut

* Masterscript: max_sut running and pending

* Masterscript: max_sut running and pending

* Masterscript: mark config as done

* Masterscript: max_sut running and pending

* Masterscript: allow load_data() several times

* Masterscript: max_sut

* Masterscript: wait after start sut for better max_sut matching

* Masterscript: Remove storage only if there is any

* Masterscript: Only execute import scripts if they exist

* Masterscript: Do not start loading if nobody answers, but do not loop either

* Masterscript: Only execute import scripts if they exist

More Parameter, lightweight No Monitoring Setup, Alias and Zip

• more parameter
• lightweight no monitoring setup
• alias for job pool
• zip result folder

Persistent Volumes and Recurring Experiments

v0.5.1

Config: Current settings for K8s and JDBC (#62)

Prototype - New Experiment Structure and Detached Mode for Parallel Execution

V0.5.0 (#58)

* Prepare next release

* Masterscript: K8s sketch of generating protocol for subfolders

* Masterscript: K8s sketch of generating protocol for subfolders

* Masterscript: K8s collect log and yaml in remote result folder

* Masterscript: K8s sketch of experiment structure

* Masterscript: K8s details of experiment structure

* Git ignore result folders

* Masterscript: K8s details of experiment structure

* Masterscript: K8s details of experiment structure - run benchmarker pods

* Masterscript: K8s details of experiment structure - deep copy to make parallel clients independent

* Masterscript: K8s details of experiment structure - parallel clients configurable

* Masterscript: K8s details of experiment structure - parallel clients configurable

* Added MariaDB

* Masterscript: K8s details of experiment structure - benchmark configs using a list of numbers of clients

* Added MySQL, OmniSci and PostgreSQL

* Masterscript: K8s details of experiment structure - benchmark configs separate module

* Masterscript: K8s details of experiment structure - send start time and check DBMS before loading

* Masterscript: K8s details of experiment structure - send start time in UTC

* Masterscript: K8s details of experiment structure - check monitoring

* Masterscript: K8s details of experiment structure - auto mount monitoring

* TPC-H: 12 DBMS prepared

* Masterscript: K8s details of experiment structure - log loading

* Masterscript: K8s exception for stop portforward

* Masterscript: K8s cluster tool CLI

* Masterscript: K8s tools CLI - cluster management and tpch

* Masterscript: K8s details of experiment structure - data loading asynch

* Masterscript: K8s details of experiment structure - logging

* TPC-H: 12 DBMS prepared

* Masterscript: K8s tools CLI - cluster management and tpch

* TPC-H: Citus DBMS prepared

* TPC-H: Citus DBMS multi host prepared

* TPC-H: Citus DBMS multi host prepared - 2 workers

* DBMS: New service name

* Masterscript: K8s details of experiment structure - dialects

* Masterscript: K8s details of experiment structure - port-forward exceptions

* Masterscript: K8s details of experiment structure - also stop and label stateful sets of sut

* Masterscript: K8s tools CLI - cluster management get status

* Masterscript: K8s details of experiment structure - attach workers

* TPC-H: Citus DBMS multi host prepared - DDL does not attach workers

* TPC-H: Citus DBMS multi host prepared - difference .docker and .configuration

* TPC-H: Citus DBMS multi host prepared - default experiment

* TPC-H: Citus DBMS multi host prepared - parameter number of workers for TPC-H

* Masterscript: Linux compatible fetching of host infos

* Masterscript: Linux compatible fetching of host infos

* Masterscript: K8s tools CLI - cluster management get status as df

* TPC-H: Citus DBMS multi host prepared - mark loaded sut

* TPC-H: Citus DBMS multi host prepared - mark loaded sut

* Masterscript: K8s details of experiment structure - asynch loading

* Masterscript: K8s tools CLI - cluster management get status as df per experiment

* TPC-H: Citus DBMS multi host prepared - OmniSci dialect for profiling

* Masterscript: K8s details of experiment structure - time loading is int

* Masterscript: K8s details of experiment structure - time loading is float

* Masterscript: K8s tools CLI - verbose mode

* Masterscript: K8s details of experiment structure - test if monitoring is ready

* Masterscript: K8s details of experiment structure - loading time readable

* Masterscript: K8s tools CLI - stop monitoring

* Masterscript: K8s details of experiment structure - loading time readable

* Masterscript: K8s details of experiment structure - loading time must be float

* Masterscript: K8s details of experiment structure - monitoring test

* Masterscript: K8s details of experiment structure - monitoring test

* Masterscript: K8s details of experiment structure - metrics contain instance

* Masterscript: K8s details of experiment structure - reload data if pod is restarted

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - check if data is loaded

* Masterscript: K8s details of experiment structure - loading time as int

* Masterscript: Get connection info - Windows

* Masterscript: K8s details of experiment structure - check_sut

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get connection info - Windows

* Masterscript: Get loading metrics

* Masterscript: Get loading metrics

* Masterscript: K8s tools CLI - cluster management readable time loading start

* Masterscript: Get loading metrics - output log

* Masterscript: Do not load data before monitoring is ready

* Masterscript: Monitoring does not use node selector

* Masterscript: Also copy error logs to results

* TPC-H: Default request 2 cpus

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Masterscript: Stop SUT from fetching running pods

* Prepare release

Sketch of detached mode for K8s

V0.4.4 (#52)

* Prepare next release

* Masterscript: K8s allow overwriting dialect

* Masterscript: K8s change setting outside of constructor

* Masterscript: get_connection_config()

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch

* Masterscript: K8s Driver in K8s cluster first sketch - replace jar folder statically

* Masterscript: K8s Driver in K8s cluster first sketch - delete job and pod after success

* Masterscript: K8s Driver in K8s cluster first sketch - fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - dynamic code and connection

* Masterscript: K8s Driver in K8s cluster first sketch - remove fixed code

* Masterscript: K8s Driver in K8s cluster first sketch - wait for client pod to run

* Masterscript: K8s Driver in K8s cluster first sketch - print status of client pod

* Masterscript: K8s Driver in K8s cluster first sketch - dbmsbenchmarker pod shall wait 60s (str)

* Masterscript: K8s Driver in K8s cluster first sketch - wait 60s for client pod to close

* Docs: Typo

* Docs: Reference to DBMSBenchmarker and Monitoring

* Masterscript: K8s wait without tqdm

* Masterscript: K8s copy Prometheus API URL

* Masterscript: K8s port forward to service name again

* Masterscript: K8s stop port forward in detached

* Masterscript: Add more labels to K8s objects

* Masterscript: Add more labels to K8s objects - benchmarker job

* Masterscript: Add more labels to K8s objects - sut deployment

* Masterscript: Add more labels to K8s objects - sut deployment configuration

* Masterscript: Add more labels to K8s objects - service name

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - monitoring and dashboard

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - filter by labels

* Masterscript: Add more labels to K8s objects - delete by labels

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Add more labels to K8s objects - find active sut

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Cluster class

* Masterscript: Start code

* Masterscript: Start code

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - experiment

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: Add more labels to K8s objects - monitoring labels

* Masterscript: SUT deployment generated in result folder

* Masterscript: Set SUT deployment and service name

* Masterscript: Set SUT deployment and service name - lower and no _

* Masterscript: Set benchmarker job name

* Masterscript: Set SUT service name for benchmarker

* Masterscript: Delete all pods of a job

* Masterscript: K8s connection and configuration different

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs

* Masterscript: K8s client for benchmarker jobs - connect to sut

* Masterscript: K8s connection and configuration different

* Masterscript: Message for no matching job

* Masterscript: K8s client for monitoring deployment - connect to sut

* Masterscript: K8s node selector should not be None

* Masterscript: K8s node selector should not be None

* Masterscript: K8s monitoring customized url

* Masterscript: K8s write pod logs

* Masterscript: K8s copy job yaml to result folder

* Masterscript: K8s sketch of configuration class

* Masterscript: K8s make result folder if not exists

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod

* Masterscript: K8s sketch of merging results in dashboard pod

Improve inspection, TPC-H example and K8s management

V0.4.3 (#40)

* Prepare next release

* Docs: Monitoring

* K8s: v1apps.list_namespaced_deployment (new K8s version in cluster)

* K8s: Resultfolder as attribute of cluster object

* Masterscript: K8s store number of requested gpus

* Masterscript: K8s run shell scripts for loading data

* Masterscript: Allow list of jars per dbms

* Requirements: Allow current versions

* TPC-H: New specifics

* Masterscript: K8s monitoring as option

* Masterscript: K8s optional UPPER parameter of db and schema

* Masterscript: K8s DEPRECATED: we must know all jars upfront

* TPC-H: DDL for MariaDB Columnstore

* TPC-H: Bigint at MonetDB

* TPC-H: SQL Server precision and DB

* TPC-H: OmniSci sharding

* TPC-H: OmniSci template

Improve Documentation

V0.4.2 (#36)

* Prepare next release

* K8s: Parametrize DDL scripts

* K8s: No pickled reports

* Demo: Typo

* Docs: API of set_ methods

* Docs: Deployments

* Docs: DBMS

* Docs: References

Improve Documentation and TPC-H Example

V0.4.1 (#35)

* Prepare next release

* Docs: Improve

* self.connectionmanagement['singleConnection'] optional

* Docs: Improve API

* K8s: Stop experiment does not delete pod

* Docs: Improve API

* Docs: Improve API

* K8s: Script as metadata

* K8s: Escape DBMS password

* TPC-H: Dialect TSQL and Oracle

* TPC-H: Demo config

* TPC-H: Demo Exasol, OracleDB, SQLServer

TPC-H like examples

V0.3.11 (#34)

* Prepare next release

* K8s: Some demo yml files for deployments and services

* TPC-H: Some demo queries and init scripts

* TPC-H: Some demo configs and scripts

* Docs: TPC-H example

* Prepare next release 0.4.0

Improved API and workflow

v0.3.10

Legal notice in source code