Flink-cos-fs v1.10-0.2.3

remove user info config log

Flink-cos-fs v1.10-0.2.2

MD5(flink-cos-fs-hadoop-1.10.0-0.2.2.jar) = ccef5680afba4166db7849bcc60c8baf
Dependencies: hadoop-cos v8.3.4, cos-api-bundle v5.6.137.2

Feature

• 解决了前一版本中由于引入新特性以及代码修改上带来的类路径的冲突错误，建议普通存储桶使用当前版本；
• 升级了最新的 CosN 依赖。

Flink-cos-fs v1.10-0.2.1

MD5 (flink-cos-fs-hadoop-1.10.0-0.2.1.jar) = e02cbf5350b45c329b254d9143289726
MD5 (flink-cos-fs-hadoop-1.10.0-0.2.1-noshaded.jar) = 7429ef661e30863908b99fb7c32ae535
dependence: Hadoop cos v8.2.4, cos-api_bundle 5.6.112
https://github.com/tencentyun/hadoop-cos/releases/tag/v8.2.4

PS: normal customers use the flink-cos-fs-hadoop-1.10.0-0.2.1.jar pkg, if need use cos ranger can use flink-cos-fs-hadoop-1.10.0-0.2.1-noshaded.jar in Tencent EMR
(2023-03-31)

Features

• add cos ranger dependency
• when shaded Hadoop change relocation exclude the ranger relate org.apache.hadoop.ipc.** and org.apache.hadoop.fs.cosn.ranger.protocol.**
• pass-through the "qcloud.object.storage" prefix config to the COS file system used by cos ranger
• change the flink-fs-hadoop-shaded shaded same with hadoop base
• support two ways to decide whether shade apache hadoop, default is true.

Flink-cos-fs v1.10-0.2.0

MD5 (flink-cos-fs-hadoop-1.10-0.2.0.jar) = 2e524f7c6473b56e5ade03421cb4ec0f
dependence: hadoop cos v8.2.4, cos-api_bundle 5.6.112
https://github.com/tencentyun/hadoop-cos/releases/tag/v8.2.4

PS: normal bucket use flink-cos-fs-hadoop-1.10.0-0.2.0-normal.jar
(2023-02-02)

Features

• Fix cos file system resource release way, return to hadoop file system cache.
• Fix cos file system concurrent close bug, only release resource once when close file system.

Flink-cos-fs v1.10-0.1.16

MD5 (flink-cos-fs-hadoop-1.10-0.1.16.jar) = 2dc044b0cf21a2d2a29a26b4af133dff
dependence: hadoop cos v8.2.3, cos-api_bundle 5.6.112
https://github.com/tencentyun/hadoop-cos/releases/tag/v8.2.3
(2023-02-02)

Features

• Fix write stream bug;
• Add POSIX bucket config in README;
• Change ranger auth, CHDFS network, and httpcomments dependence shade;
• Use Head bucket to judge POSIX bucket;

Flink-cos-fs v1.10-0.1.15

MD5 (flink-cos-fs-hadoop-1.10-0.1.15.jar) = 031bde438f2d484fa7c5ba3a4bddd79e
dependence: hadoop cos v8.1.4, cos-api_bundle 5.6.69

(2022-06-30)

Features

• Fix the L5 support build
• Support cosn://bucket-appid/ to query POSIX bucket
• Support the extended POSIX capabilities
• Add the enabled option for the upload part checksum
• Fix the boundedIOThreadPool
• Add the 503 MPU retry

Flink-cos-fs v1.10-0.1.14

MD5 (flink-cos-fs-hadoop-1.10-0.1.14.jar) = b5d39f278fee859e6e4b03c2901cde9d
dependence: hadoop cos v8.0.8

(2022-06-09)

Features

• change the flink shade prefix back to hadoop3 keep the same to the flink

Flink-cos-fs v1.10-0.1.13

MD5 (flink-cos-fs-hadoop-1.10-0.1.13.jar) = 6e3a5820c928bcc07b67e53ac93f3bf8
dependence: hadoop cos v8.0.8

(2022-05-31)

Features

• update hadoop cos version which head after complete mpu 409

Flink-cos-fs v1.10-0.1.12

MD5 (flink-cos-fs-hadoop-1.10-0.1.12.jar) = 2c5f3462b6e88f742d86105bd5479015

(2022-05-19)

Features

• Add retry to complete MPU, which was caused by access time out 503

Flink-cos-fs v1.10-0.1.11

MD5 (flink-cos-fs-hadoop-1.10-0.1.11.jar) = 511e043522086129a1feea368e1939db

(2022-04-14)

Features

• update dependence of cos java sdk(cos_api-bundle-5.6.69) and hadoop cos(8.0.6).
• first version to separate from flink and use the own warehouse code.
• read task retry for all io exception with independent configuration.
• some other futures see hadoop cos (8.0.6)