Skip to content

Commit

Permalink
Merge pull request #14 from badrinathpatchikolla/spark-2.4
Browse files Browse the repository at this point in the history
Updated Bigquery Version
  • Loading branch information
badrinathpatchikolla authored May 20, 2022
2 parents 94c4058 + a6f06e0 commit 0cb0abf
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,15 +3,15 @@
[![Build Status](https://travis-ci.com/modakanalytics/bigquery.almaren.svg?branch=master)](https://travis-ci.com/modakanalytics/bigquery.almaren)

```
libraryDependencies += "com.github.music-of-the-ainur" %% "bigquery-almaren" % "0.0.5-2.4"
libraryDependencies += "com.github.music-of-the-ainur" %% "bigquery-almaren" % "0.0.6-$SPARK_VERSION"
```

BigQuery Connector was implemented using [https://github.com/GoogleCloudDataproc/spark-bigquery-connector](https://github.com/GoogleCloudDataproc/spark-bigquery-connector).
For more details check the following [link](https://github.com/GoogleCloudDataproc/spark-bigquery-connector).

```
spark-shell --master "local[*]" --packages "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.2-2.4,com.github.music-of-the-ainur:bigquery-almaren_2.11:0.0.4-2.4"
spark-shell --master "local[*]" --packages "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-$SPARK_VERSION,com.github.music-of-the-ainur:bigquery-almaren_2.11:0.0.6-$SPARK_VERSION"
```

Expand Down
2 changes: 1 addition & 1 deletion build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % sparkVersion % "provided",
"org.apache.spark" %% "spark-sql" % sparkVersion % "provided",
"com.github.music-of-the-ainur" %% "almaren-framework" % "0.9.3-2.4" % "provided",
"com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.23.2",
"com.google.cloud.spark" %% "spark-bigquery-with-dependencies" % "0.24.2",
"com.typesafe.scala-logging" %% "scala-logging" % "3.9.0",
"org.scalatest" %% "scalatest" % "3.0.5" % "test"
)
Expand Down

0 comments on commit 0cb0abf

Please sign in to comment.