From 5c482cd3e34b48d09e63f4e9e5d96c5344b9b298 Mon Sep 17 00:00:00 2001 From: Hendrik Saly Date: Fri, 9 Aug 2024 19:47:51 +0200 Subject: [PATCH] Some fixes for the README (#546) Signed-off-by: Hendrik Saly --- README.md | 19 ++++++++++++------- 1 file changed, 12 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 5a0134df0..b586ca44b 100644 --- a/README.md +++ b/README.md @@ -43,31 +43,36 @@ spark-sql --conf "spark.sql.extensions=org.opensearch.flint.spark.FlintPPLSparkE ### Running With both Extension ``` -spark-sql --conf "spark.sql.extensions='org.opensearch.flint.spark.FlintPPLSparkExtensions, org.opensearch.flint.spark.FlintSparkExtensions'" +spark-sql --conf "spark.sql.extensions=org.opensearch.flint.spark.FlintPPLSparkExtensions,org.opensearch.flint.spark.FlintSparkExtensions" ``` ## Build -To build and run this application with Spark, you can run: +To build and run this application with Spark, you can run (requires Java 11): ``` sbt clean standaloneCosmetic/publishM2 ``` -then add org.opensearch:opensearch-spark_2.12 when run spark application, for example, +then add org.opensearch:opensearch-spark-standalone_2.12 when run spark application, for example, ``` -bin/spark-shell --packages "org.opensearch:opensearch-spark_2.12:0.5.0-SNAPSHOT" +bin/spark-shell --packages "org.opensearch:opensearch-spark-standalone_2.12:0.6.0-SNAPSHOT" \ + --conf "spark.sql.extensions=org.opensearch.flint.spark.FlintSparkExtensions" \ + --conf "spark.sql.catalog.dev=org.apache.spark.opensearch.catalog.OpenSearchCatalog" ``` ### PPL Build & Run -To build and run this PPL in Spark, you can run: +To build and run this PPL in Spark, you can run (requires Java 11): ``` sbt clean sparkPPLCosmetic/publishM2 ``` -then add org.opensearch:opensearch-spark_2.12 when run spark application, for example, +then add org.opensearch:opensearch-spark-ppl_2.12 when run spark application, for example, ``` -bin/spark-shell --packages "org.opensearch:opensearch-spark-ppl_2.12:0.5.0-SNAPSHOT" +bin/spark-shell --packages "org.opensearch:opensearch-spark-ppl_2.12:0.6.0-SNAPSHOT" \ + --conf "spark.sql.extensions=org.opensearch.flint.spark.FlintPPLSparkExtensions" \ + --conf "spark.sql.catalog.dev=org.apache.spark.opensearch.catalog.OpenSearchCatalog" + ``` ## Code of Conduct