Skip to content

fix(ingest/gc): add limit, add actual loop for iterating over batches… #25827

fix(ingest/gc): add limit, add actual loop for iterating over batches…

fix(ingest/gc): add limit, add actual loop for iterating over batches… #25827

Triggered via push November 6, 2024 23:08
Status Success
Total duration 45m 13s
Artifacts 10
Build and Push DataHub Ingestion (Base) Docker Image
12s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
2m 22s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
39s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
4m 24s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
2m 29s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
29s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
2m 41s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
2m 19s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
25s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
2s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
11s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
12s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
43s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
25s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
39s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
41s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
49s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
50s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
49s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
36s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
3m 17s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
1m 48s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
2m 53s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
1m 48s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
7s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

32 warnings
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/mysql-setup/Dockerfile#L37
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/kafka-setup/Dockerfile#L78
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/elasticsearch-setup/Dockerfile#L48
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MySQL Setup images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan MySQL Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Kafka Setup images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan Kafka Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mce-consumer/Dockerfile#L74
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mae-consumer/Dockerfile#L73
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-gms/Dockerfile#L83
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MCE consumer images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan MCE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan GMS images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan GMS images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MAE consumer images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan MAE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-frontend/Dockerfile#L55
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Frontend images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan Frontend images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
The following actions use a deprecated Node.js version and will be forced to run on node20: github/codeql-action/upload-sarif@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Run Smoke Tests (no_cypress_suite1)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run Smoke Tests (no_cypress_suite0)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deploy to Datahub HEAD
The following actions uses node12 which is deprecated and will be forced to run on node16: isbang/[email protected]. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Deploy to Datahub HEAD
The following actions use a deprecated Node.js version and will be forced to run on node20: isbang/[email protected]. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "Test Results (smoke tests) no_cypress_suite0", "Test Results (smoke tests) no_cypress_suite1". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) no_cypress_suite0
13.5 KB
Test Results (smoke tests) no_cypress_suite1
5.34 KB
datahub-project~datahub~6CCE9V.dockerbuild
82.4 KB
datahub-project~datahub~75LLYF.dockerbuild
99.6 KB
datahub-project~datahub~I2ON94.dockerbuild
101 KB
datahub-project~datahub~IXK9F1.dockerbuild
76.7 KB
datahub-project~datahub~LOEQBT.dockerbuild
78.6 KB
datahub-project~datahub~PABACN.dockerbuild
55.6 KB
datahub-project~datahub~PBEKSO.dockerbuild
81.6 KB
datahub-project~datahub~Q74LGS.dockerbuild
52.7 KB