E2E: Flow System (happy paths) + Release (patch): 0.204.4 (#863)

* Fix Flow System Initialization

- E2E, test_get_dataset_list_flows(): update comment
- CHANGELOG.md: update
- kamu-cli, run(): changing catalog initialization order
- SystemCompact: fix argument parsing panic
- E2E, test_gql_query_api_version(): add
- kamu-cli, get_command(): remove base_catalog
- APIServerGqlQueryCommand: base_catalog -> server_catalog
- APIServerRunCommand: use only server_catalog (remove base_catalog)
- UICommand: base_catalog -> server_catalog
- WebUIServer: base_catalog -> server_catalog
- E2E: test_rest_api_request_dataset_tail(): use create_player_scores_dataset()
- APIServer: use server_catalog for axum
- kamu-cli, configure_base_catalog(): absorb UploadServiceLocal component
- kamu-cli, configure_base_catalog(): absorb task-related components
- Release (patch): 0.204.4
- MySqlAccountRepository::get_accounts_by_ids(): fix if no accounts
- E2E, test_dataset_flows_initiators(): add
- E2E, test_dataset_all_flows_paused(): add
- E2E, test_list_flows() -> test_get_dataset_list_flows()
- E2E, test_list_flows(): add
- E2E, KamuApiServerClientExt: create dataset methods returns dataset id
- E2E, KamuApiServerClientExt: introduce create dataset methods
- E2E, KamuApiServerClientExt: introduce login methods
- kamu-cli, configure_base_catalog(): absorb flow-related components
- APIServer: rename cli_catalog -> server_catalog
- APIServerRunCommand::get_access_token(): use map_int_err()
- APIServerRunCommand::validate_args(): absorb check_required_env_vars()
- APIServerRunCommand: rename cli_catalog -> server_catalog

* Fixes after rebasing

* E2E: add "ingest, datafusion" test groups for flow tests

* E2E: test_kamu_access_token_middleware(): do not ingest data

* E2E: test_dataset_trigger_flow(): add

* E2E: test_dataset_trigger_flow(): extract get_dataset_list_flows_query()

* E2E: test_dataset_trigger_flow(): activate for all DBs

* E2E: test_dataset_trigger_flow(): ignore flowId

* kamu-cli, APIServerRunCommand: return base_catalog & cli_catalog

* kamu-cli, APIServerGqlQueryCommand: return base_catalog

* E2E: test_dataset_trigger_flow(): increase sleep timeout

* E2E: test_dataset_trigger_flow(): use wait_for_flows_to_finish() instead of sleep()

* E2E: flow tests: set correct test groups

* Updates after rebasing

* CI, MacOS: exclude "containerized" tests for databases

.github/workflows/build.yaml

@@ -74,7 +74,7 @@ jobs:
             cargo-flags: --profile ci --features ingest-ftp
             nextest-flags: --cargo-profile ci --features ingest-ftp
             nextest-exclusions-main-set-tests: -E '!(test(::containerized::) | test(::database::))'
-            nextest-exclusions-database-set-part: ''
+            nextest-exclusions-database-set-part: '& !(test(::containerized::))'
             container-runtime: ''
             ipfs: false
             database: false
@@ -85,7 +85,7 @@ jobs:
             cargo-flags: --profile ci
             nextest-flags: --cargo-profile ci
             nextest-exclusions-main-set-tests: -E '!(test(::containerized::) | test(::database::))'
-            nextest-exclusions-database-set-part: ''
+            nextest-exclusions-database-set-part: '& !(test(::containerized::))'
             container-runtime: ''
             ipfs: false
             database: false

CHANGELOG.md

@@ -11,7 +11,7 @@ Recommendation: for ease of reading, use the following order:
 - Fixed
 -->
 
-## [Unreleased]
+## [0.204.4] - 2024-09-30
 ### Changed
 - CLI command tweaks:
   - Make `--yes / -y` flag global
@@ -20,7 +20,9 @@ Recommendation: for ease of reading, use the following order:
   - Fixed argument parsing error in `kamu system compact` command
 - Simplified organization of startup initialization code over different components
 ### Fixed
- - Broken catalog issue for server and transactional modes  
+- Broken catalog issue for server and transactional modes  
+  - Added several E2E tests (happy paths) covering the Flows tab in the UI
+- Corrected behavior of `MySqlAccountRepository::get_accounts_by_ids()`, for the case of empty IDs collection
 
 ## [0.204.3] - 2024-09-26
 ### Fixed