-
Notifications
You must be signed in to change notification settings - Fork 518
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to make sure the number of workes per core are being used? #581
Comments
@merleyc Hi, the CPU utilization rate reported by If you did not observe a significant speedup, it can be caused by various reasons, including your algorithm, communication medium etc... Personally I use Hope it helps! |
I am using dmlc-submit to submit the job like this:
./dmlc-core/tracker/dmlc-submit --cluster=local --num-workers=X --worker-cores=Y python myscript.py
It seems the parameters --num-workers and --worker-cores are not working.
When I launch my script with --num-workers=1, the %CPU seen through the Linux top command is much bigger than 100%.
When I change only the Y variable, the runtime difference does not change as I expected. Also I didn't find under dmlc-core code where --worker-cores is being used. Any idea?
Also, given I am using a python script, how do you track the details of a distributed script (e.g., number of tasks per workers, etc.)? I know that by using top command I can see the number of workers but I don't know how to get extra information.
Thanks!
The text was updated successfully, but these errors were encountered: