# download hadoop conf before building
docker build -t hdp-spark2-client .
# submit spark job
docker run --rm --volume /usr/local/spark2/examples/:/jars --network host hdp-spark2-client spark-submit --master yarn --class org.apache.spark.examples.SparkPi /jars/spark-examples*
# hadoop hdfs client
docker run --rm --volume hadoop fs -ls /
-
Notifications
You must be signed in to change notification settings - Fork 1
deltaprojects/hdp-spark2-client
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
HDP Spark 2 client with zulu-openjdk 8
Resources
Stars
Watchers
Forks
Packages 0
No packages published