Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Cryptographic hash functions #788

Merged
merged 6 commits into from
Oct 22, 2024

Conversation

Gokul-Radhakrishnan
Copy link
Contributor

Description

Used spark's builtin Cryptographic hash functions in PPL

Issues Resolved

#759

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link
Member

@YANG-DB YANG-DB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Gokul-Radhakrishnan for your contribution
Please add an example in the example commands doc
and also add an integration test for an actual values queries from a table in the PPL integration test folder
thanks !!

@YANG-DB YANG-DB added Lang:PPL Pipe Processing Language support 0.6 labels Oct 17, 2024
@YANG-DB
Copy link
Member

YANG-DB commented Oct 17, 2024

@LantaoJin @penghuo please review and add u'r feedback

Signed-off-by: Gokul R <[email protected]>
@LantaoJin
Copy link
Member

Please add some IntegTests for new functions. It could help us to verify the correctness.

@LantaoJin
Copy link
Member

@Gokul-Radhakrishnan
Copy link
Contributor Author

Will add the integration tests and update the readme file

@Gokul-Radhakrishnan
Copy link
Contributor Author

Please add some IntegTests for new functions. It could help us to verify the correctness.

Added Integration tests

@YANG-DB
Copy link
Member

YANG-DB commented Oct 21, 2024

@Gokul-Radhakrishnan please run sbt scalafmtAll prior to commit
Thanks

Copy link
Member

@YANG-DB YANG-DB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please run sbt scalafmtAll prior to commit

Signed-off-by: Gokul R <[email protected]>
Signed-off-by: Gokul R <[email protected]>
@Gokul-Radhakrishnan
Copy link
Contributor Author

@YANG-DB Integration tests were failing in the build so I fixed. Can you please approve the workflows?

@YANG-DB
Copy link
Member

YANG-DB commented Oct 21, 2024

@LantaoJin plz review

Copy link
Member

@LantaoJin LantaoJin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gokul-Radhakrishnan thanks for your contribution. Merging.

import static org.opensearch.sql.expression.function.BuiltinFunctionName.TRIM;
import static org.opensearch.sql.expression.function.BuiltinFunctionName.WEEK;
import static org.opensearch.sql.expression.function.BuiltinFunctionName.WEEK_OF_YEAR;
import static org.opensearch.sql.expression.function.BuiltinFunctionName.*;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: I'd like to use specific static import instead of .*.
You can set Class count to use import with '*' to 99 and Name count to use static import with '*' to 99 in IDEA Settings->Editor->Code Stype->Java to prevent the auto merging.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure

@LantaoJin LantaoJin merged commit 0b6da30 into opensearch-project:main Oct 22, 2024
4 checks passed
kenrickyap pushed a commit to Bit-Quill/opensearch-spark that referenced this pull request Dec 11, 2024
* Implement Cryptographic hash functions

Signed-off-by: Gokul R <[email protected]>

* update documentation

Signed-off-by: Gokul R <[email protected]>

* added integration tests and updated readme file

Signed-off-by: Gokul R <[email protected]>

* format the code

Signed-off-by: Gokul R <[email protected]>

* fix integration tests

Signed-off-by: Gokul R <[email protected]>

---------

Signed-off-by: Gokul R <[email protected]>
Signed-off-by: Gokul-Radhakrishnan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.6 Lang:PPL Pipe Processing Language support
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants