diff --git a/CHANGELOG.md b/CHANGELOG.md index 2b6a303..f0a9451 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,11 @@ +0.4.1 (2020-04-30) +================== + +* [Enhancement] [#37](https://github.com/civitaspo/embulk-output-s3_parquet/pull/37) Rewrite the integration tests to make writing and reading tests easier & Use Diagrams for all test cases. +* [Enhancement] [#38](https://github.com/civitaspo/embulk-output-s3_parquet/pull/38) Make all column types enable to use LogicalTypeHandler. +* [Enhancement] [#38](https://github.com/civitaspo/embulk-output-s3_parquet/pull/38) Make parquet schema testable. +* [New Feature] [#38](https://github.com/civitaspo/embulk-output-s3_parquet/pull/38) Support timestamp-nanos. + 0.4.0 (2020-04-28) ================== diff --git a/README.md b/README.md index 5a76a54..47e8cef 100644 --- a/README.md +++ b/README.md @@ -24,7 +24,7 @@ - **column_options**: a map whose keys are name of columns, and values are configuration with following parameters (optional) - **timezone**: timezone if type of this column is timestamp. If not set, **default_timezone** is used. (string, optional) - **format**: timestamp format if type of this column is timestamp. If not set, **default_timestamp_format**: is used. (string, optional) - - **logical_type**: a Parquet logical type name (`timestamp-millis`, `timestamp-micros`, `json`, `int8`, `int16`, `int32`, `int64`, `uint8`, `uint16`, `uint32`, `uint64`) (string, optional) + - **logical_type**: a Parquet logical type name (`timestamp-millis`, `timestamp-micros`, `timestamp-nanos`, `json`, `int8`, `int16`, `int32`, `int64`, `uint8`, `uint16`, `uint32`, `uint64`) (string, optional) - **canned_acl**: grants one of [canned ACLs](https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#CannedACL) for created objects (string, default: `private`) - **block_size**: The block size is the size of a row group being buffered in memory. This limits the memory usage when writing. Larger values will improve the I/O when reading but consume more memory when writing. (int, default: `134217728` (128MB)) - **page_size**: The page size is for compression. When reading, each page can be decompressed independently. A block is composed of pages. The page is the smallest unit that must be read fully to access a single record. If this value is too small, the compression will deteriorate. (int, default: `1048576` (1MB)) @@ -84,6 +84,7 @@ |:---|:---|:---| |timestamp-millis|timestamp|| |timestamp-micros|long|Glue cannot recognize timestamp-micros.| + |timestamp-nanos|long|Glue cannot recognize timestamp-nanos.| |int8|tinyint|| |int16|smallint|| |int32|int|| @@ -105,7 +106,7 @@ - **password** proxy password (string, optional) - **buffer_dir**: buffer directory for parquet files to be uploaded on S3 (string, default: Create a Temporary Directory) - **type_options**: a map whose keys are name of embulk type(`boolean`, `long`, `double`, `string`, `timestamp`, `json`), and values are configuration with following parameters (optional) - - **logical_type**: a Parquet logical type name (`timestamp-millis`, `timestamp-micros`, `json`, `int8`, `int16`, `int32`, `int64`, `uint8`, `uint16`, `uint32`, `uint64`) (string, optional) + - **logical_type**: a Parquet logical type name (`timestamp-millis`, `timestamp-micros`, `timestamp-nanos`, `json`, `int8`, `int16`, `int32`, `int64`, `uint8`, `uint16`, `uint32`, `uint64`) (string, optional) ## Example diff --git a/build.gradle b/build.gradle index 024c3e4..d97c049 100644 --- a/build.gradle +++ b/build.gradle @@ -11,7 +11,7 @@ repositories { } group = "pro.civitaspo" -version = "0.4.0" +version = "0.4.1" description = "Dumps records to S3 Parquet." sourceCompatibility = 1.8