Skip to content

Commit

Permalink
fix(redshift writer): move to new redshift community lib
Browse files Browse the repository at this point in the history
  • Loading branch information
lyogev committed Sep 21, 2020
1 parent f8416cd commit 7ec78e9
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ class RedshiftOutputWriter(props: Map[String, String], redshiftDBConf: Option[Re
})

log.info(s"Writing dataframe to Redshift' table ${props("dbTable")}")
val writer = df.write.format("com.databricks.spark.redshift")
val writer = df.write.format("io.github.spark_redshift_community.spark.redshift")
.option("url", redshiftDBConf.jdbcURL)
.option("forward_spark_s3_credentials", true)
.option("tempdir", redshiftDBConf.tempS3Dir)
Expand Down

0 comments on commit 7ec78e9

Please sign in to comment.