Skip to content

[Flink/Rust] Adjust rolling file logic to reduce memory usage during … #46

[Flink/Rust] Adjust rolling file logic to reduce memory usage during …

[Flink/Rust] Adjust rolling file logic to reduce memory usage during … #46

Triggered via push January 20, 2024 07:57
Status Success
Total duration 18m 36s
Artifacts 5

maven-test.yml

on: push
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 19 warnings
spark-test-2
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
flink-test-1
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
build-rust-linux-x86_64
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build-rust-linux-x86_64
unused import: `std::collections::HashMap`
build-rust-linux-x86_64
unused import: `path::PathBuf`
build-rust-linux-x86_64
unused import: `schema_from_metadata_str`
build-rust-linux-x86_64
unused import: `util::pretty::print_batches`
build-rust-linux-x86_64
unused import: `std::ops::Deref`
build-rust-linux-x86_64
unused imports: `Partitioning as LogicalPartitioning`, `Repartition`, `Sort`
build-rust-linux-x86_64
unused import: `datafusion::physical_plan::repartition::RepartitionExec`
build-rust-linux-x86_64
unused import: `Partitioning`
build-rust-linux-x86_64
unused import: `create_physical_sort_expr`
build-rust-linux-x86_64
unused import: `LogicalPlanBuilder`
build-rust-linux-x86_64
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build-rust-linux-x86_64
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build-rust-linux-x86_64
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build-rust-linux-x86_64
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
flink-test-rbac
Created directory '/home/runner/.ssh'. # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 Identity added: /home/runner/.ssh/id_rsa (runner@fv-az1016-585)
flink-test-rbac
WARNING: /opt/hostedtoolcache/hdfs/3.3.6/x64/logs does not exist. Creating. 2024-01-20 08:00:43,411 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = fv-az1016-585/10.1.0.34 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.3.6 STARTUP_MSG: classpath = /opt/hostedtoolcache/hdfs/3.3.6/x64/etc/hadoop:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-udt-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-servlet-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-handler-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-stomp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-security-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-configuration2-2.8.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-sctp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/curator-framework-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-mqtt-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/hadoop-auth-3.3.6.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-webapp-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-io-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-dns-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jett
spark-test-rbac
Created directory '/home/runner/.ssh'. # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 # localhost:22 SSH-2.0-OpenSSH_8.9p1 Ubuntu-3ubuntu0.6 Identity added: /home/runner/.ssh/id_rsa (runner@fv-az973-888)
spark-test-rbac
WARNING: /opt/hostedtoolcache/hdfs/3.3.6/x64/logs does not exist. Creating. 2024-01-20 08:00:47,269 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = fv-az973-888.lyxwbwkowfpetlaump2twx55qb.ex.internal.cloudapp.net/10.1.0.87 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.3.6 STARTUP_MSG: classpath = /opt/hostedtoolcache/hdfs/3.3.6/x64/etc/hadoop:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-udt-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-servlet-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-handler-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-stomp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-security-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-configuration2-2.8.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-transport-sctp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/curator-framework-5.2.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-mqtt-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/hadoop-auth-3.3.6.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-webapp-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jetty-io-9.4.51.v20230217.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/netty-codec-dns-4.1.89.Final.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hostedtoolcache/hdfs/3.3.6/x64/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hostedto

Artifacts

Produced during runtime
Name Size
lakesoul-nativeio-x86_64-unknown-linux-gnu-maven-test Expired
18.6 MB
lakesoul-nativemetadata-x86_64-unknown-linux-gnu-maven-test Expired
1.96 MB
maven-test-report-artifact-flink-1 Expired
17.4 KB
maven-test-report-artifact-spark-1 Expired
23.7 KB
maven-test-report-artifact-spark-2 Expired
17 KB