-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Persistent cluster #938
base: master
Are you sure you want to change the base?
Persistent cluster #938
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
all looks fine except JobDispatcher should be a handle and idle job should be written launched between other jobs.
Iddle job would keep cluster running and regularly asking if other job is submitted.
Cluster dies after iddle job runs specified time interval
As first step here would be making JD a handle and everything else could be done as the next step
f97b8b6
to
29caf4f
Compare
29caf4f
to
20b31cf
Compare
Potentially breaking changes, experiment to see how tests are affected.
Design might need further work