Add cluster name in spark submit params

[noCharger]

Description

Add cluster name in spark submit params

Issues Resolved

#2465

Check List

• New functionality includes testing.
  • All tests pass, including unit test, integration test and doctest
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (797276d) 95.40% compared to head (c9bb54d) 95.41%.
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##               main    #2467   +/-   ##
=========================================
  Coverage     95.40%   95.41%           
  Complexity     5000     5000           
=========================================
  Files           479      479           
  Lines         13939    13950   +11     
  Branches        937      937           
=========================================
+ Hits          13299    13310   +11     
  Misses          618      618           
  Partials         22       22           

Flag	Coverage Δ
sql-engine	95.41% <100.00%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[noCharger]

https://github.com/opensearch-project/sql/actions/runs/7402675720/job/20141020203?pr=2467

CI failed on an unrelated code path:Task :core:test

DateTimeFunctionTest > testWeekOfYearWithTimeType() FAILED
YearweekTest > testYearweekWithTimeType() FAILED

Create a issue to track the fix #2468

[vamsimanohar]

https://github.com/opensearch-project/sql/actions/runs/7402675720/job/20141020203?pr=2467

CI failed on an unrelated code path:Task :core:test

DateTimeFunctionTest > testWeekOfYearWithTimeType() FAILED YearweekTest > testYearweekWithTimeType() FAILED

Create a issue to track the fix #2468

Can we comment those and verify if the rest of the tests are working fine. Just to be sure the new code is not causing any regression.
You can comment them run CI and uncomment them back.

[noCharger]

Can we comment those and verify if the rest of the tests are working fine. Just to be sure the new code is not causing any regression.

@vamsi-amazon I don't think these failed UTs are related to the new code. It has causing CI failed for a while (for example it shown in previous PR https://github.com/opensearch-project/sql/actions/runs/7383460047/job/20084703703?pr=2464)

Also all CI tasks in spark component are succeeded.

> Task :spark:compileTestJava
Note: D:\a\sql\sql\spark\src\test\java\org\opensearch\sql\spark\asyncquery\AsyncQueryExecutorServiceSpec.java uses or overrides a deprecated API.

Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :spark:processTestResources
> Task :spark:testClasses
> Task :spark:junit4
> Task :spark:test
> Task :spark:jacocoTestReport
> Task :spark:jacocoTestCoverageVerification
> Task :spark:check
> Task :spark:build

[noCharger]

Thanks team for the review, can someone merge this PR?