Cannot seem to get allocated gres info from Node

[robgics]

I'm using pyslurm.Nodes.load() to get a list of all nodes...that works fine. And I can print out a lot of things from them. But I cannot yet seem to get an accurate measure of used gres (gpus). I started 3 jobs each requesting 2 gpus each. I can see from squeue that the jobs are running, and if I use "scontrol show node" on the node that a job started on, I can see in the AllocTRES output that I am using the 2 gpus. I can also use "scontrol --details show node < nodename>" and that will give me GresUsed.

However, when I output all of the nodes from pyslurm, specifically the node.allocated_gres, it shows an empty dict. I note that in the code itself, allocated_gres references "self.info.gres_used", so if that's the same gres_used that is in the scontrol output, then something is wrong with how pyslurm gets that value.

I also notice that tres_configured and tres_alloc are commented out in the Node class def.

Thanks for the help.

[tazend]

Hi,

I have created a new issue from this discussion: #315 , so we can continue troubleshooting there (for things like bugs it would always be best to open an issue instead of a discussion)

[robgics]

Hi! I'm happy to create an issue instead of a discussion, but I'm not versed enough with pyslurm to know what's a bug vs. I'm just using it wrong, so I err on the side of ignorance. I'd hate to create an issue/bug report and it's just me being dumb. Rob

…

________________________________ From: tazend ***@***.***> Sent: Friday, August 25, 2023 2:15 PM To: PySlurm/pyslurm ***@***.***> Cc: Groner, Rob ***@***.***>; Author ***@***.***> Subject: Re: [PySlurm/pyslurm] Cannot seem to get allocated gres info from Node (Discussion #314) Hi, I have created a new issue from this discussion: #315<#315> , so we can continue troubleshooting there (for things like bugs it would always be best to open an issue instead of a discussion) — Reply to this email directly, view it on GitHub<#314 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AHZTT7XOY4CLOMHLRHHY2XTXXDTU3ANCNFSM6AAAAAA36XN43E>. You are receiving this because you authored the thread.Message ID: ***@***.***>

[tazend]

No worries, all good. If in doubt, just make an issue :)