Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

Cannot set extraJavaOptions #263

Open
reith opened this issue Jan 28, 2018 · 2 comments
Open

Cannot set extraJavaOptions #263

reith opened this issue Jan 28, 2018 · 2 comments

Comments

@reith
Copy link

reith commented Jan 28, 2018

Using dcos spark run I cannot provide more than one jvm option by spark.executor.extraJavaOptions. I tried these:

$ dcos spark run --submit-args='--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions="-XX:+UseG1GC -XX:+PrintFlagsFinal" --class ClassPath LibraryPath'
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args='--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions="-XX:+UseG1GC\ -XX:+PrintFlagsFinal" --class ClassPath LibraryPath'
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions='-XX:+UseG1GC\ -XX:+PrintFlagsFinal' --class ClassPath LibraryPath"
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf 'spark.executor.extraJavaOptions=-XX:+UseG1GC -XX:+PrintFlagsFinal' --class ClassPath LibraryPath"
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions=-XX:+UseG1GC --conf spark.executor.extraJavaOptions=-XX:+PrintFlagsFinal --class ClassPath LibraryPath"
Passes only -XX:+PrintFlagsFinal to JVM

Spark CLI version: 0.5.5

@vishnu2kmohan
Copy link

@reith Yes, this a known issue that we are working to address.

@vishnu2kmohan
Copy link

@reith Please let us know if you continue to run into this issue with the latest 2.5.0-2.2.1 release.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants