-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
More information about resource utilization is needed? #111
Comments
Hi @lee212 , can you have a look at the dictionaries returned in https://github.com/radical-cybertools/radical.analytics/blob/devel/bin/rp_inspect/plot_util.py#L115 (from ra.Session.utilization) - does that help? Those dicts contain rather fine grained information about what unit or pilot utilized what core for what reason. This is an internal data structure, so it's not well documented - but you may want to dump them with |
Yes, I was looking at the line
get_provided_resources and get_consumed_resources might be good to be added in the stat file. |
The information in them is usually too voluminous to be printed in detail - those basically contain (IIRC) tuples like |
@lee212 should we close this ticket? |
Resource utilization is revealed in detail e.g. per resource slot (index) in the matplotlib figure png file but it doesn't seem to have enough information in the
stats
file. Values in the stats are elapsed seconds of particular metrics e.g. Execution Cmd, Draining, which are important for TTX calculation. What I am interested in, however, is to see how many resources e.g. CPU cores are busy versus idle in a given time. Right now, I manually divide the core seconds of Execution Cmd from thestats
file by allocated number of cores to produce a percentage. I believeprovided
andconsumed
would be sufficient to be added in thestat
file for more information on resource utilization.The text was updated successfully, but these errors were encountered: