Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump Flint version to 0.2.0 #183

Merged
merged 2 commits into from
Jan 4, 2024

Conversation

dai-chen
Copy link
Collaborator

@dai-chen dai-chen commented Dec 6, 2023

Description

Bump Flint current version to 0.2.0 in main branch.

Testing

Version in artifact name:

$ sbt clean assembly
$ find . -name "*-0.2.0-SNAPSHOT.jar"
./spark-sql-application/target/scala-2.12/sql-job-assembly-0.2.0-SNAPSHOT.jar
./flint-spark-integration/target/scala-2.12/flint-spark-integration-assembly-0.2.0-SNAPSHOT.jar
./ppl-spark-integration/target/scala-2.12/ppl-spark-integration-assembly-0.2.0-SNAPSHOT.jar

Version in Flint index metadata (currently version field represents Flint code version. We can add another field specVersion for specification version as needed):

$  spark-sql \
 --jars /home/hadoop/flint-spark-integration-assembly-0.2.0-SNAPSHOT.jar 
 --conf spark.sql.extensions=org.opensearch.flint.spark.FlintSparkExtensions  ...

spark-sql> CREATE SKIPPING INDEX ON ds_tables.http_logs
         > (status VALUE_SET);
{
  "flint_myglue_ds_tables_http_logs_skipping_index": {
    "mappings": {
      "_meta": {
        "latestId": "ZmxpbnRfbXlnbHVlX2RzX3RhYmxlc19odHRwX2xvZ3Nfc2tpcHBpbmdfaW5kZXg=",
        "kind": "skipping",
        "indexedColumns": [
          {
            "columnType": "int",
            "kind": "VALUE_SET",
            "columnName": "status"
          }
        ],
        "name": "flint_myglue_ds_tables_http_logs_skipping_index",
        "options": {
          "auto_refresh": "false"
        },
        "source": "myglue.ds_tables.http_logs",
        "version": "0.2.0",
        "properties": {}
      },
      "properties": {
        "file_path": {
          "type": "keyword"
        },
        "status": {
          "type": "integer"
        }
      }
    }
  }
}

Issues Resolved

N/A

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@dai-chen dai-chen self-assigned this Dec 6, 2023
@dai-chen dai-chen marked this pull request as ready for review December 6, 2023 23:20
@dai-chen dai-chen merged commit 1f89aaf into opensearch-project:main Jan 4, 2024
4 checks passed
@dai-chen dai-chen deleted the bump-flint-version-0.2 branch January 4, 2024 23:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants