Spark Cluster Shell Support spark shell run in yarn shell. For some speciall enviroment dev env hadoop 3.0.0 spark 2.4.0 scala 2.11.12