Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

warnings from darshan-job-summary.pl when autoperf APMPI data is present #12

Open
carns opened this issue Mar 2, 2022 · 2 comments
Open

Comments

@carns
Copy link
Contributor

carns commented Mar 2, 2022

The darshan-job-summary.pl tool produces output that looks like this if executed on a darshan log with Autoperf APMPI data present:

Use of uninitialized value $str in substitution (s///) at /home/carns/working/install/lib/TeX/Encode.pm line 137, <PARSE_OUT> line 467.
Use of uninitialized value $str in substitution (s///) at /home/carns/working/install/lib/TeX/Encode.pm line 138, <PARSE_OUT> line 467.
Use of uninitialized value $str in substitution (s///) at /home/carns/working/install/lib/TeX/Encode.pm line 139, <PARSE_OUT> line 467.
Use of uninitialized value $str in substitution (s///) at /home/carns/working/install/lib/TeX/Encode.pm line 140, <PARSE_OUT> line 467.
...

I'm getting over 2,000 lines similar to that when running it on a single process mpi-io benchmark log.

It looks like the issue is that the Autoperf parsed output does not have the same number of columns as other Darshan modules, in particular the file name, mount pt, and fs type fields are missing. It looks like there are also warnings later due to some counters having string rather than numeric values.

I'm not sure what the best fix is; either APMPI (and other Autoperf modules if they have the same problem, I haven't checked the others) needs to add dummy columns to the output or darshan-job-summary.pl should be modified to skip AP records.

This problem is peculiar to darshan-job-summary since it is using perl to parse string output from darshan parser, but we need to fix it until the Python tools are mature enough to deprecate it.

@carns
Copy link
Contributor Author

carns commented Mar 2, 2022

As a side note, if the best fix is on the darshan-job-summary.pl side, then we can move this ticket to the Darshan repo.

@shanedsnyder
Copy link
Contributor

This can be closed now -- fixed via following PR in Darshan: darshan-hpc/darshan#760

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants