Add langType to FlintStatement model #663
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…#552) (opensearch-project#553) (cherry picked from commit 61c9620) Signed-off-by: Sean Kao <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…pensearch-project#554) (opensearch-project#557) (cherry picked from commit def26cf) Signed-off-by: Tomoyuki Morita <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…project#544) (opensearch-project#561) (cherry picked from commit c733d3c) Signed-off-by: Lantao Jin <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…h-project#521) (opensearch-project#566) * Translate PPL Dedup Command: only one duplication allowd * add document --------- (cherry picked from commit 7c4244f) Signed-off-by: Lantao Jin <[email protected]> Signed-off-by: YANGDB <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: YANGDB <[email protected]>
This reverts commit d6e71fa.
…h-project#574) (cherry picked from commit 15ee355) Signed-off-by: Tomoyuki Morita <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ect#579) * Add PPL describe command update correlation comment as experimental * update README doc with desc command add extended=true for describe command * update README doc with desc command add extended=true for describe command * update failed test --------- (cherry picked from commit a91bf35) Signed-off-by: YANGDB <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…roject#549) (opensearch-project#582) * Implement stddev_samp and stddev_pop ppl stats function (cherry picked from commit 6fc2010) Signed-off-by: Hendrik Saly <[email protected]> Signed-off-by: Kacper Trochimiak <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Kacper Trochimiak <[email protected]>
…rch-project#584) * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * Adding support for Rare & Top PPL top [N] <field-list> [by-clause] N: number of results to return. Default: 10 field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- rare <field-list> [by-clause] field-list: mandatory. comma-delimited list of field names. by-clause: optional. one or more fields to group the results by. ------------------------------------------------------------------------------------------- commands: - opensearch-project#461 - opensearch-project#536 * update scala fmt style * add additional support for `rare` & `top` commands options * add additional support for `rare` & `top` commands options including top N ... * update scalafmtAll style format * remove unrelated agg test --------- (cherry picked from commit 4af03c2) Signed-off-by: YANGDB <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
) * fix nested fields query and filter issues as specified in - opensearch-project#508 - opensearch-project#503 * fix nested fields query and filter issues as specified in - opensearch-project#508 - opensearch-project#503 * fix scalafmtAll formatting * update README doc with desc command * update failed test * update new nested test class * add correlation tests to identity issue with nested query fix * add correlation tests to identity issue with nested query fix * add correlation tests to identity issue with nested query fix * add nested fields query sample to the README.md --------- (cherry picked from commit aa55968) Signed-off-by: YANGDB <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ect#588) * percentile prototype * add tests for stats: percentile * Add PERCENTILE_APPROX * Add functions to readme * Add null checks * Fix tests, add tests --------- (cherry picked from commit f283df8) Signed-off-by: Hendrik Saly <[email protected]> Signed-off-by: Kacper Trochimiak <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Kacper Trochimiak <[email protected]>
…earch-project#591) * Fix distinct_count, Add test for distinct_count * add tests for stats: distinct_count (#1) add tests for stats: distinct_count * Add functions to readme * Fix comparePlans --------- (cherry picked from commit b407a06) Signed-off-by: Hendrik Saly <[email protected]> Signed-off-by: Kacper Trochimiak <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Kacper Trochimiak <[email protected]>
…ct#495) (opensearch-project#576) * fix missed renames * rename for log entry properties * correct typo planTransformer * add FlintIndexMetadataService * interface class for FlintIndexMetadataService * move FlintMetadata and FlintVersion to flint-commons * remove ser/de from FlintMetadata; move to OS impl for FlintIndexMetadataService * remove schema parser in FlintMetadata builder to remove dependency to opensearch * FlintSparkIndex generate not only schema json but also map * FlintMetadataSuite divided into two: one for builder and one for ser/de, which is merged to FlintOpenSearchIndexMetadataServiceSuite * move get metadata functions to new service * Remove getIndexMetadata and getAllIndexMetadata from FlintClient * Implement the two for OpenSearch * TODO: sanitize index name * Add builder for FlintIndexMetadataService and options * Refactor caller of FlintClient.get(All)IndexMetadata with FlintIndexMetadataService * TODO: test suite for getIndexMetadata and getAllIndexMetadata (might overlap with FlintOpenSearchClientSuite) * update index metadata * remove updateIndex from FlintClient * implement updateIndexMetadata for FlintOpenSearchIndexMetadataService * updateIndexMetadata upon create index in FlintSpark * for OS client + OS index metadata service, the call for update is redundant * it's for when some other index metadata service implementation is provided * TODO: Suite for updateIndexMetadata (now shared with FlintOpenSearchClientSuite) * empty implementation for OS deleteIndexMetadata * sanitize index name * fix new FlintOption missing from FlintSparkConf * fix FlintOpenSearchClientSuite * delete file (missed in resolving conflict) * Use service builder in OpenSearchCluster * fix service builder class * fix FlintOptions for custom class spark properties * remove SparkConf from builder argument * fix IT * add test suites * sanitize index name for opensearch metadata log * remove spark-warehouse files * exclude _meta field for createIndex in OpenSearch * catch client creation exception * Fetch metadata for OpenSearch table * OpenSearchCluster move to java file because scala object cannot be mocked in mockito * update doc with spark config --------- (cherry picked from commit f5ad574) Signed-off-by: Sean Kao <[email protected]>
…#577) (opensearch-project#592) * Add conf for specifying flint checkpoint location * Add IT and public doc --------- (cherry picked from commit 5c190b3) Signed-off-by: Louis Chu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…-project#594) * Add retry to bulk request * Retry only failed items * Address comments * Fix isCreateConflict * Add and fix unit tests --------- (cherry picked from commit 3db16ec) Signed-off-by: Tomoyuki Morita <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…storage (opensearch-project#381) (opensearch-project#605) * REPL refactor * Ignore UT * Add seqNo and primaryTerm to session object * Address os client concurrency limitation * Add interface for query execution * Clean up logs and add UTs * Clean up and fix UTs --------- (cherry picked from commit aa509ac) Signed-off-by: Louis Chu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ct#603) (opensearch-project#614) * Add UT and IT for 2+ level aggregations PPL command * doc --------- (cherry picked from commit eb2bbb6) Signed-off-by: Lantao Jin <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
opensearch-project#628) * Add checkpoint abstraction and IT * Add UT and more doc * Add more IT --------- (cherry picked from commit 88ad15f) Signed-off-by: Chen Dai <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ensearch-project#632) * Update checkpoint location on alter path * Resolve comments --------- (cherry picked from commit 9ac50a7) Signed-off-by: Louis Chu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…pensearch-project#635) (opensearch-project#637) * Refactor FlintJob with FlintStatement and StatementExecutionManager * Resolve comments --------- (cherry picked from commit 7d8f2b0) Signed-off-by: Louis Chu <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…earch-project#646) (opensearch-project#648) (cherry picked from commit 06c8c66) Signed-off-by: Tomoyuki Morita <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…h-project#654) (cherry picked from commit 4563bda) Signed-off-by: Lukasz Soszynski <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Add langType to FlintStatement model
Issues Resolved
N/A
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.