Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#1185 - Integration Test for Kafka/ElasticSearch #1197

Merged
merged 3 commits into from
Oct 22, 2024

Conversation

duylv27
Copy link
Contributor

@duylv27 duylv27 commented Oct 16, 2024

This PR is to add integration test for kafka, and elasticsearch (CDC Events sync data for ElasticSearch). The test will have

  • Kafka:

    • One Kafka instance.
    • A manually created Product CDC topic (not the one created by the Debezium connector).
    • A Product Producer that publishes events to the CDC topic.
  • Elasticsearch:

    • One Elasticsearch instance.
    • A consumer that loads data from the CDC topic.
    • The following consumer behaviors will be verified.

Consumer behaviors will be verified:

  • Does the consumer consume events as expected? (sync by event operation)
  • In case of an error, does the consumer perform a retry? (can improve more by verifying dead-letter queue topic in case retry failed).

Copy link

Recommendation Coverage Report

Overall Project NaN% NaN% 🍏

There is no coverage information present for the Files changed

Copy link

github-actions bot commented Oct 16, 2024

Search Coverage Report

Overall Project 93.34% -0.64% 🍏
Files changed 89.47% 🍏

File Coverage
ProductSyncDataConsumer.java 89.47% -10.53% 🍏

@duylv27 duylv27 force-pushed the feature/yas-1148-kafka-it branch 2 times, most recently from e13a8a8 to e5914e4 Compare October 16, 2024 14:38
@duylv27 duylv27 marked this pull request as ready for review October 17, 2024 02:49
@duylv27
Copy link
Contributor Author

duylv27 commented Oct 17, 2024

Must proceed #1182 first

@duylv27 duylv27 changed the base branch from main to feature/yas-1148 October 21, 2024 07:56
@duylv27 duylv27 changed the base branch from feature/yas-1148 to feature/yas-1148-1 October 21, 2024 07:56
@duylv27 duylv27 force-pushed the feature/yas-1148-kafka-it branch 2 times, most recently from 162cc61 to 1ac4576 Compare October 21, 2024 08:23
@duylv27 duylv27 changed the base branch from feature/yas-1148-1 to main October 21, 2024 08:27
Copy link

sonarcloud bot commented Oct 22, 2024

Copy link

sonarcloud bot commented Oct 22, 2024

@khanhtrand khanhtrand merged commit 9b4083e into main Oct 22, 2024
9 checks passed
@khanhtrand khanhtrand deleted the feature/yas-1148-kafka-it branch October 22, 2024 08:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants