8.1.4 Fix CVE-2024-47561 in dependency

This release fixes vulnerability CVE-2024-47561 by updating transitive dependency org.apache.avro:avro via com.exasol:parquet-io-java.

Security Issues

• #171: Fixed vulnerability CVE-2024-47561 in org.apache.avro:avro

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:parquet-io-java:2.0.10 to 2.0.11
• Updated de.siegmar:fastcsv:3.3.0 to 3.3.1

Test Dependency Updates

• Updated nl.jqno.equalsverifier:equalsverifier:3.16.2 to 3.17.1
• Updated org.junit.jupiter:junit-jupiter-params:5.11.0 to 5.11.2
• Updated org.mockito:mockito-junit-jupiter:5.13.0 to 5.14.2

8.1.3 Adapt tests to fixed bug in Exasol

This release updates integration tests, adapting to a fixed bug in ALTER VIRTUAL SCHEMA. This allows running the shared integration tests against the latest version of Exasol DB.

Bugfixes

• #169: Adapted shared integration tests to bugfix in Exasol

Dependency Updates

Compile Dependency Updates

• Updated de.siegmar:fastcsv:3.2.0 to 3.3.0

Test Dependency Updates

• Updated com.exasol:hamcrest-resultset-matcher:1.6.5 to 1.7.0
• Updated nl.jqno.equalsverifier:equalsverifier:3.16.1 to 3.16.2
• Updated org.hamcrest:hamcrest:2.2 to 3.0
• Updated org.junit.jupiter:junit-jupiter-params:5.10.3 to 5.11.0
• Updated org.mockito:mockito-junit-jupiter:5.12.0 to 5.13.0

8.1.2 Fix CVE-2024-25638 in `dnsjava:dnsjava:jar:3.4.0:compile`

This release fixes vulnerability CVE-2024-25638 in dnsjava:dnsjava:jar:3.4.0:compile.

Security

• #166: Fixed vulnerability CVE-2024-25638 in dnsjava:dnsjava:jar:3.4.0:compile

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:parquet-io-java:2.0.9 to 2.0.10

Plugin Dependency Updates

• Updated org.apache.maven.plugins:maven-jar-plugin:3.3.0 to 3.4.2

8.1.1 Test `ALTER VIRTUAL SCHEMA <schema> REFRESH`

This release adds integration tests that verify that ALTER VIRTUAL SCHEMA <schema> REFRESH reads the updated EDML mapping from BucketFS.

Note: There is a known issue in the Exasol database that causes changes to a virtual schema to be lost when only adapter notes are changed but not the schema itself.

Note: This adds the following method to AbstractDocumentFilesAdapterIT. Update your test to add an implementation for this method.

protected abstract Bucket getBucketFSDefaultBucket();

Dependency Updates

Compile Dependency Updates

• Updated de.siegmar:fastcsv:3.1.0 to 3.2.0

Test Dependency Updates

• Updated org.junit.jupiter:junit-jupiter-params:5.10.2 to 5.10.3

8.1.0 Configure column names for automatic mapping inference

This release allows configuring the mapping of column names for the automatic mapping inference in Parquet and CSV files. Before, the virtual schema always converted source column names to UPPER_SNAKE_CASE to create the Exasol column names. This is now configurable with EDML property autoInferenceColumnNames. This property supports the following values:

• CONVERT_TO_UPPER_SNAKE_CASE: Convert column names to UPPER_SNAKE_CASE (default).
• KEEP_ORIGINAL_NAME: Do not convert column names, use column name from source.

See the EDML user guide for details.

Features

• #163: Added option to keep original column name for auto inference

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document:10.1.2 to 11.0.0

Test Dependency Updates

• Updated com.exasol:virtual-schema-common-document:10.1.2 to 11.0.0
• Added com.jparams:to-string-verifier:1.4.8
• Removed org.apache.commons:commons-text:1.12.0

Plugin Dependency Updates

• Updated com.exasol:project-keeper-maven-plugin:4.3.2 to 4.3.3

8.0.4 Security update - fix for CVE-2024-36114

Fixed CVE-2024-36114 GHSA-973x-65j7-xcf4.
Updated dependencies.

Security

• #161: CVE-2024-36114: io.airlift:aircompressor:jar:0.21:compile

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:parquet-io-java:2.0.8 to 2.0.9
• Updated com.exasol:virtual-schema-common-document:10.1.1 to 10.1.2

Test Dependency Updates

• Updated com.exasol:udf-debugging-java:0.6.12 to 0.6.13
• Updated com.exasol:virtual-schema-common-document:10.1.1 to 10.1.2
• Updated org.apache.commons:commons-text:1.11.0 to 1.12.0
• Updated org.mockito:mockito-junit-jupiter:5.11.0 to 5.12.0

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:2.0.2 to 2.0.3
• Updated com.exasol:project-keeper-maven-plugin:4.3.0 to 4.3.2
• Updated org.apache.maven.plugins:maven-deploy-plugin:3.1.1 to 3.1.2
• Updated org.apache.maven.plugins:maven-enforcer-plugin:3.4.1 to 3.5.0
• Updated org.apache.maven.plugins:maven-gpg-plugin:3.2.2 to 3.2.4
• Updated org.apache.maven.plugins:maven-javadoc-plugin:3.6.3 to 3.7.0
• Updated org.apache.maven.plugins:maven-toolchains-plugin:3.1.0 to 3.2.0
• Updated org.sonarsource.scanner.maven:sonar-maven-plugin:3.11.0.3922 to 4.0.0.4121
• Updated org.sonatype.plugins:nexus-staging-maven-plugin:1.6.13 to 1.7.0

8.0.3 Fix CVE-2024-29131 & CVE-2024-29133 in `org.apache.commons:commons-configuration2:jar:2.8.0:compile`

This release fixes vulnerabilities CVE-2024-29131 & CVE-2024-29133 in org.apache.commons:commons-configuration2:jar:2.8.0:compile.

Security

• #157: Fixed CVE-2024-29131 in org.apache.commons:commons-configuration2:jar:2.8.0:compile
• #158: Fixed CVE-2024-29133 in org.apache.commons:commons-configuration2:jar:2.8.0:compile

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:parquet-io-java:2.0.7 to 2.0.8

Test Dependency Updates

• Updated nl.jqno.equalsverifier:equalsverifier:3.15.8 to 3.16.1

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:2.0.1 to 2.0.2
• Updated com.exasol:project-keeper-maven-plugin:4.2.0 to 4.3.0
• Updated org.apache.maven.plugins:maven-compiler-plugin:3.12.1 to 3.13.0
• Updated org.apache.maven.plugins:maven-gpg-plugin:3.1.0 to 3.2.2
• Updated org.jacoco:jacoco-maven-plugin:0.8.11 to 0.8.12
• Updated org.sonarsource.scanner.maven:sonar-maven-plugin:3.10.0.2594 to 3.11.0.3922

8.0.2: Fix reading duplicate values

This release fixes a bug introduced with version 8.0.1 / PR #153. When reading a CSV with headers and duplicate values like the following

header1,header2
duplicate-value,duplicate-value
value1,value2

the virtual schema query failed with error

de.siegmar.fastcsv.reader.CsvParseException: Exception when reading record that started in line 2
...
Caused by: java.lang.IllegalStateException: E-VSDF-72: Duplicate field 'duplicate-value' at line number 2 / field index 1, all fields: ['header2', 'duplicate-value', 'header1']
...

Bugfix

• #154: Fixed bug when reading CSV with duplicate values

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document:10.1.0 to 10.1.1

Test Dependency Updates

• Updated com.exasol:virtual-schema-common-document:10.1.0 to 10.1.1

8.0.1: Fix CVE-2024-26308, CVE-2024-25710 and CVE-2023-52428 in compile dependencies

This release fixes vulnerabilities in the following compile dependencies:

• org.apache.commons:commons-compress:jar:1.24.0:compile
  • CVE-2024-26308
  • CVE-2024-25710
• com.nimbusds:nimbus-jose-jwt:jar:9.8.1:compile
  • CVE-2023-52428

Security

• #152: Fixed CVE-2024-26308 in org.apache.commons:commons-compress:jar:1.24.0:compile
• #151: Fixed CVE-2024-25710 in org.apache.commons:commons-compress:jar:1.24.0:compile
• #150: Fixed CVE-2023-52428 in com.nimbusds:nimbus-jose-jwt:jar:9.8.1:compile

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:parquet-io-java:2.0.6 to 2.0.7
• Updated de.siegmar:fastcsv:2.2.2 to 3.1.0

Test Dependency Updates

• Updated com.exasol:hamcrest-resultset-matcher:1.6.3 to 1.6.5
• Updated com.exasol:udf-debugging-java:0.6.11 to 0.6.12
• Updated nl.jqno.equalsverifier:equalsverifier:3.15.4 to 3.15.8
• Updated org.junit.jupiter:junit-jupiter-params:5.10.1 to 5.10.2
• Updated org.mockito:mockito-junit-jupiter:5.8.0 to 5.11.0

Plugin Dependency Updates

• Updated com.exasol:error-code-crawler-maven-plugin:1.3.1 to 2.0.1
• Updated com.exasol:project-keeper-maven-plugin:2.9.17 to 4.2.0
• Updated org.apache.maven.plugins:maven-compiler-plugin:3.11.0 to 3.12.1
• Updated org.apache.maven.plugins:maven-javadoc-plugin:3.6.2 to 3.6.3
• Updated org.apache.maven.plugins:maven-surefire-plugin:3.2.2 to 3.2.5
• Added org.apache.maven.plugins:maven-toolchains-plugin:3.1.0
• Updated org.codehaus.mojo:flatten-maven-plugin:1.5.0 to 1.6.0

8.0.0: Support Exasol 8

Summary

This release upgrades to virtual-schema-common-document:10.1.0 which adds support for Exasol 8. This brings the following changes for virtual schemas:

Remove support for TIMESTAMP WITH LOCAL TIME ZONE

This release adds support for Exasol 8 by removing support for data type TIMESTAMP WITH LOCAL TIME ZONE. This type caused problems with the stricter type checks enabled by default in Exasol, causing pushdown queries for document based virtual schemas to fail with the following error:

Data type mismatch in column number 5 (1-indexed).Expected TIMESTAMP(3) WITH LOCAL TIME ZONE, but got TIMESTAMP(3).

We fixed this error by removing support TIMESTAMP WITH LOCAL TIME ZONE completely. This is a breaking change, so we updated the version to 8.0.0.

Support ALTER VIRTUAL SCHEMA SET

This release adds support for ALTER VIRTUAL SCHEMA SET. This will allow changing properties like MAPPING of document based virtual schemas without dropping and re-creating the virtual schema:

-- Update EDML mapping of the virtual schema
ALTER VIRTUAL SCHEMA MY_VIRTUAL_SCHEMA SET MAPPING = '...';

-- Enable remote logging or change the log level
ALTER VIRTUAL SCHEMA MY_VIRTUAL_SCHEMA SET DEBUG_ADDRESS = 'host:3000' LOG_LEVEL = 'FINEST';
ALTER VIRTUAL SCHEMA MY_VIRTUAL_SCHEMA SET LOG_LEVEL = 'INFO';

See the documentation for ALTER SCHEMA for details.

Features

• #148: Added support for Exasol version 8

Dependency Updates

Compile Dependency Updates

• Updated com.exasol:virtual-schema-common-document:9.4.3 to 10.1.0
• Updated io.deephaven:deephaven-csv:0.12.0 to 0.14.0

Test Dependency Updates

• Updated com.exasol:hamcrest-resultset-matcher:1.6.1 to 1.6.3
• Updated com.exasol:virtual-schema-common-document:9.4.3 to 10.1.0
• Updated nl.jqno.equalsverifier:equalsverifier:3.15.2 to 3.15.4
• Updated org.apache.commons:commons-text:1.10.0 to 1.11.0
• Updated org.junit.jupiter:junit-jupiter-params:5.10.0 to 5.10.1
• Updated org.mockito:mockito-junit-jupiter:5.6.0 to 5.8.0

Plugin Dependency Updates

• Updated com.exasol:project-keeper-maven-plugin:2.9.13 to 2.9.17
• Added org.apache.maven.plugins:maven-enforcer-plugin:3.4.1
• Updated org.apache.maven.plugins:maven-javadoc-plugin:3.6.0 to 3.6.2
• Updated org.apache.maven.plugins:maven-surefire-plugin:3.1.2 to 3.2.2
• Updated org.codehaus.mojo:versions-maven-plugin:2.16.1 to 2.16.2