Skip to content

Commit

Permalink
Modify spark.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ChengJie1053 committed Sep 15, 2023
1 parent 5c3f79e commit ece1fe3
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/configuration/spark.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@

Use spark yarn cluster mode,need to set label "engingeConnRuntimeMode": "yarnCluster",and need to upload the dependence of the spark to 'linkis.spark.yarn.cluster.jar'(the default value is 'hdfs:///spark/cluster')
spark dependencies include jars and configuration files,For example: '/appcom/Install/linkis/lib/linkis-engineconn-plugins/spark/dist/3.2.1/lib/*.jar','/appcom/Install/linkis/conf/*'

Precautions for using yarnCluster:
Eureka url if 127.0.0.1 should be changed to the real host, such as "127.0.0.1:20303/eureka/" should be changed to "wds001:20303/eureka/"

Expand Down

0 comments on commit ece1fe3

Please sign in to comment.