Skip to content

Releases: civitaspo/digdag-operator-athena

0.4.0

19 Oct 18:22
bb19e79
Compare
Choose a tag to compare
  • [Enhancement] Update dependencies: aws-sdk 1.11.587 -> 1.11.653, digdag 0.9.37 -> 0.9.39
  • [Fix] Fix README: athena.query> preview option is false by default
  • [New feature] Support auth_method: web_identity_token

0.3.2

06 Aug 04:30
ee61b71
Compare
Choose a tag to compare
  • [Fix] aws.glue.list bug: limit does not work correctly.
  • [New feature] Add athena.each_database> operator

0.3.1

05 Aug 10:02
eb918f9
Compare
Choose a tag to compare
  • [Fix -- athena.ctas>] When using save_mode: overwrite, delete the specified table and location, not the table location that the data catalog has.
  • [New feature -- athena.drop_table_multi>] protect option.

0.3.0

30 Jul 06:05
56e7d18
Compare
Choose a tag to compare
  • [Breaking change -- athena.ctas>] Remove output option which has been deprecated since v0.2.2.
  • [Breaking change -- athena.ctas>] Remove select_query option which has been deprecated since v0.2.0.
  • [Note -- athena.ctas>] Replace com.google.common.base.Optional -> scala.Option.
  • [Enhancement -- athena.ctas>] Add / as suffix if location option does not have.
  • [Change -- athena.ctas>] Use athena.drop_table> operator instead of athena.query> operator when deleting the table.
    • This change is to reduce the number of query executions.
    • athena.ctas> operator depends on Glue privileges by this change.
  • [Note -- athena.ctas>] Use default database if not database option specified.

0.2.5

29 Jul 08:17
5e88785
Compare
Choose a tag to compare
  • [Fix] Catch any initialization exception and re-throw as ConfigException

0.2.4

29 Jul 04:18
c280ef6
Compare
Choose a tag to compare
  • [New Feature] Add athena.table_exists?> operator
  • [New Feature] Add athena.partition_exists?> operator

0.2.3

19 Jul 05:49
fa82f07
Compare
Choose a tag to compare
  • [New Feature] Add athena.drop_table_multi> operator
  • [Enhancement] Expose the real error message and state when the query execution is failed.

0.2.2

19 Jul 02:43
6ac81c0
Compare
Choose a tag to compare
  • [Enhancement] Use scala-logging for logging instead of using slf4j directly
  • [Enhancement] Use workgroup default output location for athena query result output location.
  • [Change - athena.ctas>] Introduce location option and output option become deprecated.

0.2.1

16 Jul 06:12
30be2c0
Compare
Choose a tag to compare
  • [Enhancement] Add format, compression and field_delimiter options to athena.apas> operator. If not set, these are detected automatically.

0.2.0

16 Jul 01:51
1a98ee8
Compare
Choose a tag to compare
  • [New Feature] Add athena.apas> operator.
  • [Enhancement] Use scala 2.13.0
  • [New Feature] athena.add_partition> operator
  • [New Feature] athena.drop_partition> operator
  • [New Feature] athena.drop_table> operator
  • [Enhancement] Suppress aws-java-sdk log
  • [Note] Use aws-java-sdk-glue for catalog operations.
  • [Breaking Change - athena.query>] preview option is false by default.
  • [Enhancement - athena.ctas>] Remove ; from the query.
  • [Enhancement] Create wrappers for aws-java-sdk for the readability and the separation of responsibilities.
    • The change of STS has a possibility to break the backward compatibility of assume role behavior.
  • [Enhancement] Introduce region variable for Aws to resolve region according to auth_method option.
  • [New Feature] Add workgroup option.
  • [Breaking Change - athena.query] Remove the output option as the deprecation is notified from before.
  • [Deprecated - athena.ctas>] Make select_query deprecated.
  • [Note] Introduce pro.civitaspo.digdag.plugin.athena.aws package to divide dependencies about aws.
  • [Note] Use the Intellij formatter instead of spotless, so remove spotless from CI.