Skip to content

Commit

Permalink
Spark AWS image: add spark-defaults.conf
Browse files Browse the repository at this point in the history
  • Loading branch information
@vprus
vprus committed Feb 15, 2024
1 parent c68f618 commit 9323fc6
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions images/spark-defaults.conf
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
spark.hadoop.fs.s3.impl: org.apache.hadoop.fs.s3a.S3AFileSystem
spark.hadoop.fs.s3a.aws.credentials.provider: com.amazonaws.auth.DefaultAWSCredentialsProviderChain

0 comments on commit 9323fc6

Please sign in to comment.