Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add_passthru_arg on hadoop #2204

Open
ghost opened this issue Sep 23, 2020 · 0 comments
Open

add_passthru_arg on hadoop #2204

ghost opened this issue Sep 23, 2020 · 0 comments

Comments

@ghost
Copy link

ghost commented Sep 23, 2020

Hi,

i have a problem to pass an additional command line argument ((--target) to an MRJob on a hadoop (v2.7.3.2.6.5.0) cluster. The argument is introduced via self.add_passthru_arg in def configure_args(self) in a python script called micIteration.py

The argument is correctly processed on my local computer but when I try to run the same job on a hadoop cluster it says
Usage: micIteration.py [options] [input files]
micIteration.py: error: no such option: --target

Complete call
python micIteration.py -r hadoop --hadoop-streaming-jar /usr/hdp/2.6.5.0-292/hadoop-mapreduce/hadoop-streaming.jar --target=100 input_file.txt

Any advice?

Cheers,
Ralf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

0 participants