Skip to content

[SPARK-45654][PYTHON] Add Python data source write API #6430

[SPARK-45654][PYTHON] Add Python data source write API

[SPARK-45654][PYTHON] Add Python data source write API #6430

Triggered via push November 1, 2023 00:14
Status Success
Total duration 1h 58m 46s
Artifacts 9

build_main.yml

on: push
Run  /  Check changes
37s
Run / Check changes
Run  /  Breaking change detection with Buf (branch-3.5)
1m 6s
Run / Breaking change detection with Buf (branch-3.5)
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
1h 13m
Run / Run Spark on Kubernetes Integration test
Matrix: Run / build
Matrix: Run / java-other-versions
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
1h 56m
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 11 warnings
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-21966a8b885bdf1c-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-c2c71b8b885cf8de-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$679/0x00007f0ec05c6d68@67e7e302 rejected from java.util.concurrent.ThreadPoolExecutor@2c82d0c[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 309]
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$679/0x00007f0ec05c6d68@432be25b rejected from java.util.concurrent.ThreadPoolExecutor@2c82d0c[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 310]
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-1cc43c8b8872a48b-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-7754e78b8873bba0-exec-1".
Run / Run Spark on Kubernetes Integration test
HashSet() did not contain "decomtest-ae15cc8b8877bab4-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-2205cceeae74485c9f0723a9ac6297aa-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-2205cceeae74485c9f0723a9ac6297aa-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
Run / Build modules: sql - other tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: hive - other tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: mllib-local,mllib
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: hive - slow tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: core, unsafe, kvstore, avro, utils, network-common, network-shuffle, repl, launcher, examples, sketch, graphx
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: sql - extended tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: api, catalyst, hive-thriftserver
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-streaming
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: streaming, sql-kafka-0-10, streaming-kafka-0-10, yarn, kubernetes, hadoop-cloud, spark-ganglia-lgpl, connect, protobuf
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: sql - slow tests
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-errors
No files were found with the provided path: **/target/test-reports/*.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
test-results-pyspark-connect--17-hadoop3-hive2.3 Expired
411 KB
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect--17-hadoop3-hive2.3 Expired
1.18 MB
test-results-pyspark-pandas--17-hadoop3-hive2.3 Expired
1.46 MB
test-results-pyspark-pandas-connect-part0--17-hadoop3-hive2.3 Expired
1.32 MB
test-results-pyspark-pandas-connect-part1--17-hadoop3-hive2.3 Expired
1.42 MB
test-results-pyspark-pandas-connect-part2--17-hadoop3-hive2.3 Expired
953 KB
test-results-pyspark-pandas-connect-part3--17-hadoop3-hive2.3 Expired
530 KB
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3 Expired
2.86 MB
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3 Expired
401 KB