Skip to content

Commit

Permalink
Modify SparkEngineConnFactory
Browse files Browse the repository at this point in the history
  • Loading branch information
ChengJie1053 committed Sep 15, 2023
1 parent fd34629 commit 1771c5a
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -154,7 +154,7 @@ class SparkEngineConnFactory extends MultiExecutorEngineConnFactory with Logging
sparkConf.getOption("spark.master").getOrElse(CommonVars("spark.master", "yarn").getValue)
logger.info(s"------ Create new SparkContext {$master} -------")

val isYarnClusterMode: Boolean = LabelUtil.isYarnClusterMode(engineCreationContext.getLabels())
val isYarnClusterMode = LabelUtil.isYarnClusterMode(engineCreationContext.getLabels())

if (isYarnClusterMode) {
sparkConf.set("spark.submit.deployMode", "cluster")
Expand Down

0 comments on commit 1771c5a

Please sign in to comment.