Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor SparkQueryDispatcher #2636

Merged
merged 3 commits into from
Apr 30, 2024

Conversation

ykmr1224
Copy link
Collaborator

Description

Refactor SparkQueryDispatcher to reduce the direct dependency (pure refactoring).

  • Extracted QueryHandlerFactory to remove constructor dependency to query hander classes and direct dependent classes.
  • Reduced redundancy of code and improved readability.

Issues Resolved

N/A

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Tomoyuki Morita <[email protected]>
@ykmr1224
Copy link
Collaborator Author

Removed EMRServerlessClientFactory from SparkQueryDispatcher, and fixed build error due to spotless check

@ykmr1224 ykmr1224 force-pushed the refactor-spark branch 2 times, most recently from 986cbc7 to bbed24a Compare April 29, 2024 18:27
@vmmusings vmmusings added maintenance Improves code quality, but not the product backport 2.x labels Apr 30, 2024
@vmmusings vmmusings merged commit d32cf94 into opensearch-project:main Apr 30, 2024
22 of 28 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Apr 30, 2024
* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <[email protected]>

---------

Signed-off-by: Tomoyuki Morita <[email protected]>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
ykmr1224 pushed a commit to ykmr1224/sql that referenced this pull request May 13, 2024
* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <[email protected]>

---------

Signed-off-by: Tomoyuki Morita <[email protected]>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
ykmr1224 added a commit that referenced this pull request May 14, 2024
* Refactor SparkQueryDispatcher (#2636)

* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <[email protected]>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <[email protected]>

---------

Signed-off-by: Tomoyuki Morita <[email protected]>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix conflicted test case

Signed-off-by: Tomoyuki Morita <[email protected]>

---------

Signed-off-by: Tomoyuki Morita <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@ykmr1224 ykmr1224 deleted the refactor-spark branch June 12, 2024 22:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x maintenance Improves code quality, but not the product
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants