Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add config + implementation for stand-by instantly-available "runners" (for hot code paths) #416

Open
alvin opened this issue Sep 14, 2024 · 1 comment
Assignees
Labels
app: runner Concerns the Runner priority: low Indicates a low priority issue type: enhancement New feature or request weight: 2 An issue with a low development impact
Milestone

Comments

@alvin
Copy link

alvin commented Sep 14, 2024

What would you like to be added:

  • Docker and/or other runtime substrates and/or the system itself could be configured to have N "runner" instances on standby, ready to respond to events or requests

Why is this needed:

  • Some "hot path" code scenarios will benefit greatly from instant execution of workflow functions vs. waiting for a runtime environment to spin up.

Things to consider:

  • Process security/isolation + concurrency factors
  • Should it be limited to functions / calculations without external side-effects? Something like a dedicated pool of runners to handle all python or all javascript "call" requests?
  • Or consider a set of input context constraints that result in an isolated "pool" of runners that do have external connections -- what comes to mind for me here is a runner instance (or group/set) that has an open database read/write connection to an external database -- for isolation purposes we might want to route to that runner/set only when the requesting tenant context matches that of the runner/set
  • Where to configure this functionality?
  • Where to code/enable this functionality?: In the operator? The correlator? (Or even isolated to the runtime layers -- eg. maybe K8S/helm supports it but docker doesn't)

@cdavernas is this an accurate feature request based on our discussion?

@cdavernas
Copy link
Member

@alvin yes, sounds perfect! Thank you!!!

@cdavernas cdavernas self-assigned this Sep 14, 2024
@cdavernas cdavernas added type: enhancement New feature or request priority: low Indicates a low priority issue weight: 2 An issue with a low development impact app: runner Concerns the Runner labels Sep 14, 2024
@cdavernas cdavernas added this to the v1.0.0 milestone Sep 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
app: runner Concerns the Runner priority: low Indicates a low priority issue type: enhancement New feature or request weight: 2 An issue with a low development impact
Projects
Status: Backlog
Development

No branches or pull requests

2 participants