Skip to content

Flink-cos-fs v1.10-0.2.1

Pre-release
Pre-release
Compare
Choose a tag to compare
@vintmd vintmd released this 31 Mar 02:41
· 15 commits to master since this release
8cfa561

MD5 (flink-cos-fs-hadoop-1.10.0-0.2.1.jar) = e02cbf5350b45c329b254d9143289726
MD5 (flink-cos-fs-hadoop-1.10.0-0.2.1-noshaded.jar) = 7429ef661e30863908b99fb7c32ae535
dependence: Hadoop cos v8.2.4, cos-api_bundle 5.6.112
https://github.com/tencentyun/hadoop-cos/releases/tag/v8.2.4

PS: normal customers use the flink-cos-fs-hadoop-1.10.0-0.2.1.jar pkg, if need use cos ranger can use flink-cos-fs-hadoop-1.10.0-0.2.1-noshaded.jar in Tencent EMR
(2023-03-31)

Features

  • add cos ranger dependency
  • when shaded Hadoop change relocation exclude the ranger relate org.apache.hadoop.ipc.** and org.apache.hadoop.fs.cosn.ranger.protocol.**
  • pass-through the "qcloud.object.storage" prefix config to the COS file system used by cos ranger
  • change the flink-fs-hadoop-shaded shaded same with hadoop base
  • support two ways to decide whether shade apache hadoop, default is true.