Skip to content

[SPARK-43380][SQL][FOLLOW-UP] Fix slowdown in Avro read #6429

[SPARK-43380][SQL][FOLLOW-UP] Fix slowdown in Avro read

[SPARK-43380][SQL][FOLLOW-UP] Fix slowdown in Avro read #6429

Triggered via push October 31, 2023 23:46
Status Success
Total duration 3h 27m 28s
Artifacts 9

build_main.yml

on: push
Run  /  Check changes
38s
Run / Check changes
Run  /  Base image build
1m 2s
Run / Base image build
Run  /  Breaking change detection with Buf (branch-3.4)
1m 17s
Run / Breaking change detection with Buf (branch-3.4)
Run  /  Scala 2.13 build with SBT
19m 22s
Run / Scala 2.13 build with SBT
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
1h 13m
Run / Run Spark on Kubernetes Integration test
Matrix: Run / build
Matrix: Run / java-11-17
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
1h 43m
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 7 warnings
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-84fac38b884119f4-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-8a71a28b88424a85-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$573/1888348064@5fdf5309 rejected from java.util.concurrent.ThreadPoolExecutor@449eef05[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 331]
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$573/1888348064@bc11371 rejected from java.util.concurrent.ThreadPoolExecutor@449eef05[Shutting down, pool size = 3, active threads = 2, queued tasks = 0, completed tasks = 330]
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-b37c0f8b8858ff96-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-7d5ac18b885a24b9-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-d89e208b885e4472-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-ffece9602a9042caa256c4edb70cd1fa-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-ffece9602a9042caa256c4edb70cd1fa-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
Run / Build modules: catalyst, hive-thriftserver
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: hive - other tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: hive - slow tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: sql - other tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: sql - extended tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: sql - slow tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-errors
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
test-results-core, unsafe, kvstore, avro, network-common, network-shuffle, repl, launcher, examples, sketch, graphx--8-hadoop3-hive2.3 Expired
124 KB
test-results-pyspark-connect--8-hadoop3-hive2.3 Expired
598 KB
test-results-pyspark-core, pyspark-streaming, pyspark-ml--8-hadoop3-hive2.3 Expired
292 KB
test-results-pyspark-pandas--8-hadoop3-hive2.3 Expired
1.21 MB
test-results-pyspark-pandas-connect--8-hadoop3-hive2.3 Expired
1020 KB
test-results-pyspark-pandas-slow--8-hadoop3-hive2.3 Expired
1.53 MB
test-results-pyspark-pandas-slow-connect--8-hadoop3-hive2.3 Expired
1.23 MB
test-results-pyspark-sql, pyspark-mllib, pyspark-resource, pyspark-testing--8-hadoop3-hive2.3 Expired
383 KB
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, mllib-local, mllib, yarn, mesos, kubernetes, hadoop-cloud, spark-ganglia-lgpl, connect, protobuf--8-hadoop3-hive2.3 Expired
568 KB