Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CloudSQL MySQL Plugin e2e test cases #199

Open
wants to merge 5 commits into
base: develop
Choose a base branch
from

Conversation

sawantpritam
Copy link
Contributor

@tivv @rmstar @itsankit-google Please review.

@@ -0,0 +1,123 @@
<?xml version="1.0" encoding="UTF-8"?>
<!--
Copyright © 2015-2019 Cask Data, Inc.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2022


<groupId>io.cdap.plugin</groupId>
<artifactId>e2e-test</artifactId>
<version>2.9.0-SNAPSHOT</version>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should it 1.9.0-SNAPSHOT?

<version>1.9.0-SNAPSHOT</version>

@@ -0,0 +1,120 @@
/*
* Copyright © 2021 Cask Data, Inc.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2022

public class E2ETestUtils {
private static Properties pluginProperties = new Properties();
private static Properties errorProperties = new Properties();
private static final Logger logger = Logger.getLogger(E2ETestUtils.class);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use slf4j

  private static final Logger LOG = LoggerFactory.getLogger(E2ETestUtils.class);

Feature: CloudSQLMySQl Sink Design Time

@CLDMYSQL @TC-Mandatory-fields
Scenario Outline:Verify CloudSQLMYSQL Sink properties validation errors for mandatory fields
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for clarify, can we add source and sink test features in separate directories?

Then Post records count from CloudSQLMySQL table "clsTableNameBQCS"
Then Validate the output record count
Then Validate successMessage is displayed
Then Validate the count of records transferred from BigQuery "clsTableNameBQ" to CloudSqlMySql "clsTableNameBQCS"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In addition to checking the number of records transferred, also validate that the correct data is written to the sink in all the test cases

clsProjectID=cdf-athena
clsTableNameBQ=tableabc
clsTableNameBQ1=tablecloud
clsBucket=gs://cdf-athena-test/TestingGCS.csv
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

load data from the repo instead of depending on data existing in a GCS bucket. For example, see google-cloud tests - https://github.com/data-integrations/google-cloud/tree/develop/src/e2e-test/resources/testdata

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants