Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DBZ-7273: Test SQL Server PR created against fresh main branch #154

Closed
wants to merge 18 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
8841257
[release] Development version for testing module deps
debezium-builder Jan 21, 2024
151b7bc
[docs] incremental snapshot: blocking snapshot are also supported
JordanP Jan 18, 2024
738f2f8
DBZ-7366 use withMaskedPasswords()
koneru9999 Jan 19, 2024
17d3df6
DBZ-7022 Allow conversion of source block timestamp fields
ani-sha Jan 9, 2024
47765a0
DBZ-7022 Add documentation for metadata conversion in TZ SMT
ani-sha Jan 10, 2024
78a54a3
DBZ-7022 Adjust prefix names, simplify null check
ani-sha Jan 17, 2024
5be134e
DBZ-7022 Use prefix names from Envelope class
ani-sha Jan 17, 2024
218da53
DBZ-7314 Update `column.include.list` note and property description
roldanbob Jan 22, 2024
986303b
DBZ-7376 Fix logging for schema only recovery in mysql
akanimesh7 Jan 23, 2024
26261c8
DBZ-7362 Support DECFLOAT in Db2 connector
leoloel Jan 23, 2024
0344b67
[ci] Bump tj-actions/changed-files from 41.1.1 to 42.0.0
dependabot[bot] Jan 22, 2024
5a493be
[ci] Bump actions/cache from 2 to 4
dependabot[bot] Jan 22, 2024
f5e50b8
DBZ-7383 Bump com.jayway.jsonpath:json-path from 2.7.0 to 2.9.0 in /d…
dependabot[bot] Jan 22, 2024
ee0ea0e
DBZ-7373 Zookeeper container not being deleted quick fix + added wait…
novotnyJiri Jan 22, 2024
87ef90d
DBZ-7373 Change naming of variable containing Kafka container
novotnyJiri Jan 24, 2024
09e8f7e
DBZ-7373 Fix deploy return value in DockerKafkaConnectController
novotnyJiri Jan 24, 2024
187db57
[docs] Fix name of capture table DDL option for SQL server
vjuranek Jan 24, 2024
5462605
DBZ-7273: Introduce mode to query capture tables directly
ramanenka Dec 20, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
68 changes: 34 additions & 34 deletions .github/workflows/debezium-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ jobs:

- name: Get modified files (Common)
id: changed-files-common
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
support/checkstyle/**
Expand All @@ -62,49 +62,49 @@ jobs:

- name: Get modified files (MongoDB)
id: changed-files-mongodb
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connector-mongodb/**

- name: Get modified files (MySQL)
id: changed-files-mysql
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connector-mysql/**

- name: Get modified files (PostgreSQL)
id: changed-files-postgresql
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connector-postgres/**

- name: Get modified files (Oracle)
id: changed-files-oracle
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connector-oracle/**

- name: Get modified files (SQL Server)
id: changed-files-sqlserver
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connector-sqlserver/**

- name: Get modified files (Quarkus Outbox)
id: changed-files-outbox
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-quarkus-outbox/**

- name: Get modified files (REST Extension)
id: changed-files-rest-extension
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-connect-rest-extension/**
Expand All @@ -116,7 +116,7 @@ jobs:

- name: Get modified files (Schema Generator)
id: changed-files-schema-generator
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-schema-generator/**
Expand All @@ -128,14 +128,14 @@ jobs:

- name: Get modified files (Debezium Testing)
id: changed-files-debezium-testing
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-testing/**

- name: Get modified files (MySQL DDL parser)
id: changed-files-mysql-ddl-parser
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-ddl-parser/src/main/antlr4/io/debezium/ddl/parser/mysql/**
Expand All @@ -144,7 +144,7 @@ jobs:

- name: Get modified files (Oracle DDL parser)
id: changed-files-oracle-ddl-parser
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-ddl-parser/src/main/antlr4/io/debezium/ddl/parser/oracle/**
Expand All @@ -154,14 +154,14 @@ jobs:

- name: Get modified files (Documentation)
id: changed-files-documentation
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
documentation/**

- name: Get modified files (Storage)
id: changed-files-storage
uses: tj-actions/changed-files@v41.1.1
uses: tj-actions/changed-files@v42.0.0
with:
files: |
debezium-storage/**
Expand All @@ -183,7 +183,7 @@ jobs:

- name: Cache Maven Repository
id: maven-cache-check
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -231,7 +231,7 @@ jobs:

- name: Cache Maven Repository
id: maven-cache-check
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -272,7 +272,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -310,7 +310,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -347,7 +347,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -383,7 +383,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -423,7 +423,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -456,7 +456,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -492,7 +492,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -525,7 +525,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -558,7 +558,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -590,7 +590,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -622,7 +622,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -655,7 +655,7 @@ jobs:
java-version: 17

- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('**/pom.xml') }}
Expand Down Expand Up @@ -717,7 +717,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down Expand Up @@ -784,7 +784,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down Expand Up @@ -841,7 +841,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down Expand Up @@ -898,7 +898,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down Expand Up @@ -955,7 +955,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down Expand Up @@ -1013,7 +1013,7 @@ jobs:
# For this build, we do not care if there are or are not changes in the sibling repository since this
# job will only ever fire if there are changes in the common paths identified in the files_changed job.
- name: Cache Maven Repository
uses: actions/cache@v2
uses: actions/cache@v4
with:
path: ~/.m2/repository
key: maven-debezium-test-build-${{ hashFiles('core/**/pom.xml') }}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/oracle-workflow-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,7 @@ jobs:
# This workflow uses its own dependency cache rather than the main debezium workflow cache because
# we explicitly want to trigger this build on pushes separate from the other workflow.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
# refresh cache every month to avoid unlimited growth
Expand Down Expand Up @@ -140,7 +140,7 @@ jobs:
# This workflow uses its own dependency cache rather than the main debezium workflow cache because
# we explicitly want to trigger this build on pushes separate from the other workflow.
- name: Cache Maven Repository
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ~/.m2/repository
# refresh cache every month to avoid unlimited growth
Expand Down
1 change: 1 addition & 0 deletions COPYRIGHT.txt
Original file line number Diff line number Diff line change
Expand Up @@ -579,3 +579,4 @@ Pavithrananda Prabhu
حمود سمبول
Peter Hamer
Artem Shubovych
leoloel
2 changes: 1 addition & 1 deletion debezium-bom/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@
<version.mockito>3.0.0</version.mockito>
<version.awaitility>4.0.1</version.awaitility>
<version.testcontainers>1.19.1</version.testcontainers>
<version.jsonpath>2.7.0</version.jsonpath>
<version.jsonpath>2.9.0</version.jsonpath>
<version.jsonassert>1.5.0</version.jsonassert>
<version.org.reflections>0.9.12</version.org.reflections>
<version.cassandra.unit>3.5.0.1</version.cassandra.unit>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,13 @@ public SnapshottingTask getSnapshottingTask(MySqlPartition partition, MySqlOffse
// found a previous offset and the earlier snapshot has completed
if (previousOffset != null && !previousOffset.isSnapshotRunning()) {

LOGGER.info("A previous offset indicating a completed snapshot has been found. Neither schema nor data will be snapshotted.");
if (databaseSchema.isStorageInitializationExecuted()) {
LOGGER.info(
"A previous offset indicating a completed snapshot has been found, schema will still be snapshotted since we are in schema_only_recovery mode.");
}
else {
LOGGER.info("A previous offset indicating a completed snapshot has been found. Neither schema nor data will be snapshotted.");
}
return new SnapshottingTask(databaseSchema.isStorageInitializationExecuted(), false, dataCollectionsToBeSnapshotted, snapshotSelectOverridesByTable, false);
}

Expand Down
Loading
Loading