Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ppl spark join command #35

Closed
wants to merge 43 commits into from

Conversation

YANG-DB
Copy link
Member

@YANG-DB YANG-DB commented Sep 18, 2023

Description

initial work on adding the Join semantics for the PPL and implementing these capabilities using spark

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

YANG-DB added 30 commits August 23, 2023 14:06
add ppl statement logical plan elements
add ppl parser components
add ppl expressions components

Signed-off-by: YANGDB <[email protected]>
 -  source = $testTable
 -  source = $testTable | fields name, age
 -  source = $testTable age=25 | fields name, age

Signed-off-by: YANGDB <[email protected]>
add AggregateFunction translation & tests
remove unused DSL builder

Signed-off-by: YANGDB <[email protected]>
# Conflicts:
#	build.sbt
#	flint-spark-integration/src/test/scala/org/opensearch/flint/spark/skipping/FlintSparkSkippingIndexSuite.scala
add actual ppl based table content fetch and verification

Signed-off-by: YANGDB <[email protected]>
@YANG-DB
Copy link
Member Author

YANG-DB commented Oct 4, 2023

Postponed till 2.11 released

@YANG-DB YANG-DB closed this Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant