Releases: google/dwh-migration-tools
Releases · google/dwh-migration-tools
v1.0.65
What's Changed
- Bump net.snowflake:snowflake-jdbc from 3.19.0 to 3.19.1 by @dependabot in #624
- Bump nl.littlerobots.version-catalog-update from 0.8.4 to 0.8.5 by @dependabot in #623
- Class design cleanup for Snowflake Logs by @misolt in #590
- [improve] Configure dependabot by @vladislav-sidorovich in #629
- Bump com.google.cloud:google-cloud-nio from 0.127.25 to 0.127.26 by @dependabot in #630
- Reduce code duplication between metadata and lite connectors, allow non-enum connector properties by @misolt in #602
- Remove another connector's configuration from snowflake-lite by @misolt in #634
- [b/377253441] Add a task to get aggregate events in snowflake-lite by @misolt in #633
- [b/376638949] Don't use INFORMATION_SCHEMA in snowflake-lite by @misolt in #636
- Bump jackson from 2.18.0 to 2.18.1 by @dependabot in #637
- Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in #641
- Bump org.xerial:sqlite-jdbc from 3.46.1.3 to 3.47.0.0 by @dependabot in #639
- [improve] configure dependabot for hikari and JDK 8 by @vladislav-sidorovich in #642
- Bump org.checkerframework:checker-qual from 3.48.1 to 3.48.2 by @dependabot in #645
Full Changelog: v1.0.64...v1.0.65
v1.0.64
What's Changed
- Bump joda-time:joda-time from 2.12.7 to 2.13.0 by @dependabot in #597
- Bump org.checkerframework:checker-qual from 3.48.0 to 3.48.1 by @dependabot in #601
- Bump org.postgresql:postgresql from 42.7.3 to 42.7.4 by @dependabot in #599
- Fix bugs in ZonedIntervalIterableTest by @misolt in #598
- [b/370703701] Add more descriptive connection error message for Oracle by @kpiotrowski in #609
- Bump net.snowflake:snowflake-jdbc from 3.18.0 to 3.19.0 by @dependabot in #613
- [b/375140671] Create a new connector for SF TCO Lite by @misolt in #620
- [b/368222012] Report AccessControlException(s) in HdfsExtractionTask separately by @sten1ee in #619
- fix compile warnings by @vladislav-sidorovich in #622
- [b/374026408] Fix Hive extraction for Iceberg raw tables by @rocgranada in #614
- [b/368220129] HdfsContentSummaryTask should not fail hard on AccessControlException(s) by @sten1ee in #615
New Contributors
- @rocgranada made their first contribution in #614
Full Changelog: v1.0.63...v1.0.64
v1.0.63
What's Changed
- Remove redundant arguments from AutoService in Snowflake by @misolt in #576
- Bump org.checkerframework:checker-qual from 3.46.0 to 3.48.0 by @dependabot in #569
- Bump org.apache.commons:commons-csv from 1.11.0 to 1.12.0 by @dependabot in #578
- Output first and last query log entries for Teradata with a new task by @sayuzbas-google in #571
- Bump com.diffplug.spotless:spotless-plugin-gradle from 6.4.1 to 6.25.0 by @dependabot in #568
- Rollback spotless plugin to 6.4.1 because of java 8 support by @vladislav-sidorovich in #584
- fix spotless codestyle by @vladislav-sidorovich in #585
- Clean up class design for Snowflake Metadata by @misolt in #586
- Bump jackson from 2.17.2 to 2.18.0 by @dependabot in #588
- Bump org.apache.commons:commons-compress from 1.27.0 to 1.27.1 by @dependabot in #589
- Bump com.google.cloud:google-cloud-nio from 0.127.21 to 0.127.25 by @dependabot in #587
- [issue 114] improve error messages for JDBC driver by @vladislav-sidorovich in #579
- Bump ch.qos.reload4j:reload4j from 1.2.22 to 1.2.25 by @dependabot in #591
- Bump aws-java-sdk from 1.12.767 to 1.12.773 by @dependabot in #593
- [b/373568138] Change timestamp format used in zip entry files to work on windows by @kpiotrowski in #594
- Bump org.xerial:sqlite-jdbc from 3.46.0.1 to 3.46.1.3 by @dependabot in #596
New Contributors
- @sayuzbas-google made their first contribution in #571
Full Changelog: v1.0.62...v1.0.63
v1.0.62
What's Changed
- More precise .gitignore rules by @misolt in #575
- [b/368572924] Fix: missing data of public synonym objects by @misolt in #558
Full Changelog: v1.0.61...v1.0.62
v1.0.61
What's Changed
- [b/359499526] Dump raw Ranger API entries to output jsonl files. by @aleofreddi in #518
- [b/364818924] Remove all 'owner' filters from stats SQLs by @misolt in #553
- Provide a more descriptive error message when driver JAR does not exist by @misolt in #555
- Extract Cloudera metaconnector in-dump paths to SPI. by @damian-compilerworks in #554
- [b/355196176] Implement fail fast strategy for Teradata logs tables by @vladislav-sidorovich in #557
- [b/370428253] Rename 'Dbid' to 'DbId' by @misolt in #563
- Replace boolean flag with enum by @vladislav-sidorovich in #562
- [b/369075732] Add Teradata tables validation for additional command line options by @vladislav-sidorovich in #561
- Bump org.yaml:snakeyaml from 2.2 to 2.3 by @dependabot in #551
- update gradle lockfiles to fix snakeyaml by @vladislav-sidorovich in #564
- Update compliance information with license links by @misolt in #570
- Move license overrides to a util class by @misolt in #572
New Contributors
- @vladislav-sidorovich made their first contribution in #557
Full Changelog: v1.0.60...v1.0.61
v1.0.60
What's Changed
- Remove dwh-migration-client by @dawidxc in #521
- [b/361574176] Extract additional software packages by @dawidxc in #523
- [b/361566488] Extract user local libraries by @dawidxc in #525
- [b/353201454] Extract HDFS report by @sten1ee in #524
- Group single-line scripts in a single text file by @dawidxc in #526
- [b/356467392] Remove MIGRATION_METADATA flag by @dawidxc in #530
- [b/361568886] Extract hive properties by @dawidxc in #527
- [b/361572606] Fix the command for extracting spark version by @dawidxc in #528
- [b/353664125] Extract statuses of services by @dawidxc in #529
- [b/353201454] Ignore slow nodes extraction failure by @dawidxc in #535
- [b/362196485] Add db-links, db-link-sources SQLs by @misolt in #539
- [b/362205662] Extend Oracle source-conn-latest sql with additional columns by @kpiotrowski in #537
- [b/360840839] Extract Hadoop native libraries by @dawidxc in #532
- [b/361577312] Extract hardware, storage and HDFS details by @dawidxc in #533
- [b/357517011] Extract filenames from local filesystem by @dawidxc in #531
- [b/352490642] Add cloudera metaconnector by @dawidxc in #538
- Rename hadoop connector to cloudera-metadata by @dawidxc in #542
- Rename hdfs-permissions connector to hdfs by @dawidxc in #543
- [b/352490642] Add HDFS to Cloudera metaconnector by @dawidxc in #544
- [b/352490642] Add child connectors to metadata yaml by @dawidxc in #545
- [b/361371764] Add Java version requirement to README by @dawidxc in #547
- Make HDFS tasks optional by @dawidxc in #548
- Cleanup loggers in HDFS connector by @dawidxc in #549
- [b/364035944] Prevent a NullPointerException where a result's toString has returned null by @misolt in #552
- ParallelTaskGroup fixes by @misolt in #541
Full Changelog: v1.0.59...v1.0.60
v1.0.59
What's Changed
- [b/350521386] Add correct Oracle column name for ALL_SEQUENCES.SEQUENCE_OWNER by @ikhavkin-google in #508
- [b/359866106] Add SQLs to discover Oracle exadata and system configuration by @kpiotrowski in #520
- [b/361012673] Extract historical metrics from Oracle cdb_hist_seg_stat view by @kpiotrowski in #522
- [b/342096412] Detect Java version in the main script by @dawidxc in #434
Full Changelog: v1.0.58...v1.0.59
v1.0.58
What's Changed
- [b/353960111] Extract additional software versions by @dawidxc in #512
- [b/353527405] Add gradle version lock files by @Hackerpilot in #503
- [b/357128377] Update Java dependencies via ./gradlew versionCatalogApplyUpdates by @ajwelch4 in #504
Full Changelog: v1.0.57...v1.0.58
v1.0.57
What's Changed
- Extract metastore connection details by @sten1ee in #499
- [b/352468287] Add non-CDB sql-stats-awr by @misolt in #491
- [b/352468287] Add non-CDB versions of source-conn (latest) and hist-cmd-types-awr by @misolt in #502
- Add a summary success message for each stats SQL group by @misolt in #501
- [b/352468287] Add non-CDB version of db-features SQL by @misolt in #505
- [b/350521386] Improve Oracle sequence metadata collection by @ikhavkin-google in #500
- Move remaining Oracle Task classes to the right package by @misolt in #506
- Remove unused app-schemas-summary by @misolt in #507
- Add non-CDB versions of db-instances, dtl-index-type SQLs by @misolt in #509
- Add non-CDB versions for remaining optional SQLs extracting native data by @misolt in #511
- [b/354721825] Add Apache Ranger connector. by @aleofreddi in #494
- [b/358310586] Fix: 'url' flag does not work with Oracle connectors by @misolt in #513
- [b/355392538] Delete script tmp directory after tests by @dawidxc in #514
- Cleanup of ConnectorArguments by @misolt in #515
- Improve tests of getHost and getHostOrDefault in ConnectorArguments by @misolt in #516
New Contributors
- @ikhavkin-google made their first contribution in #500
- @aleofreddi made their first contribution in #494
Full Changelog: v1.0.56...v1.0.57
v1.0.56
What's Changed
- [b/344812305] Add more columns to the generated csv file by @sten1ee in #443
- [b/344808098] Add file size field to csv file generated by hdfs connector by @sten1ee in #467
- [b/352469141] Make oracle-stats duration customizable by @misolt in #469
- [b/344804598] Produce metadata files for hadoop connector by @dawidxc in #468
- Remove an ignored test in RecordProgressMonitor by @misolt in #458
- [b/352493863] divide oracle-stats tasks into required and optional by @misolt in #471
- [b/352469802] Update the Statspack SQLs to match changes in AWR queries by @misolt in #470
- Summary cleanup by @dawidxc in #473
- Update Statspack SQLs to match AWR by @misolt in #475
- Move all existing SQLs to a 'cdb' subdirectory by @misolt in #476
- Wrap IOException for oracle-stats SQL resources by @misolt in #477
- [b/344812305] Extract top-level folders information by @sten1ee in #474
- Oracle task package by @misolt in #478
- [b/354785499] Add a missing column header 'FileSize' in hdfs-permissions.csv by @sten1ee in #481
- [b/354119674] Refactor HdfsPermissionsExtractionTask to extend AbstractTask by @sten1ee in #479
- [b/353905712] Add metadata files for hdfs-permissions connector by @sten1ee in #484
- [Python client] Update dependencies, remove support for Python 3.7 and add support for Python 3.11 and 3.12 by @ajwelch4 in #480
- Add tools for running single-tenant SQLs conditionally by @misolt in #482
- [b/352468287] Add non-CDB versions of both db-objects SQLs by @misolt in #486
- Change log level for hadoop to info by @dawidxc in #487
- [b/352468287] Add non-CDB versions of db-info and data-types by @misolt in #485
- [b/354783600] Count files and directories separately by @sten1ee in #489
- Add more columns to AWR histcmdtypes by @misolt in #488
- Group together the attributes related to SQL scripts subdirectories by @misolt in #483
- [b/352468287] Add non-CDB table-types-dtl and used-space-details SQLs by @misolt in #490
- [b/354119249] Add HadoopHandle with HDFS FileSystem by @sten1ee in #492
- [b/355650388] Add FileType column in hdfs-permissions.csv file by @sten1ee in #493
- Make OracleConnectorScopeTest parameterized by @dawidxc in #496
- Fix output dir format in metadata yaml by @dawidxc in #495
- [b/309765009] Change support reference to Google by @dawidxc in #497
Full Changelog: v1.0.55...v1.0.56