Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wait until all processes have finished before exiting #185

Open
stdweird opened this issue Jan 27, 2022 · 0 comments
Open

wait until all processes have finished before exiting #185

stdweird opened this issue Jan 27, 2022 · 0 comments

Comments

@stdweird
Copy link
Member

looks like mpirun in openmpi sometimes finsihes while there is still a srun process running.
so mympirun is done, while the step is not finished.

this can cause problems for the next step.

simply settings export SLURM_OVERLAP=1 is way too dangerous, but might be a good workaround if you know it is safe to do (eg the step terminates in a few seconds)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant