-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Task bundling #183
Comments
Adding some background about task granularity: One use case where this would be helpful is for post-run cleanup tasks, for example, when you want to make sure that all the cleanup has occurred before other tasks that might create more files (and thereby hit some file size or number threshold) are run. |
We realized in our 10/8/21 discussion that this task bundling can be implemented using priorities. E.g., in the case of a sim task (S) and a cleanup task ( C), if we give S priority 1 (p1) and C priority 2 (p2), with p2 being a higher priority than p1, and have 2N combined S and C tasks:
The first N S tasks will run first, with the next N S tasks in the task queue. Is this enough to close this issue @j-woz, or do you think it warrants something beyond this? |
Some way to couple tasks in the queue. Could be solved with launch_multi(), but other features may be needed.
CC @jozik @ncollier
The text was updated successfully, but these errors were encountered: