Skip to content

deltaprojects/hdp-spark2-client

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# download hadoop conf before building
docker build -t hdp-spark2-client .

# submit spark job
docker run --rm --volume /usr/local/spark2/examples/:/jars --network host hdp-spark2-client spark-submit --master yarn --class org.apache.spark.examples.SparkPi /jars/spark-examples*

# hadoop hdfs client
docker run --rm --volume hadoop fs -ls /

About

HDP Spark 2 client with zulu-openjdk 8

Resources

Stars

Watchers

Forks

Packages

No packages published