Dagster ECS fargate configuration per ops rather than the full job #24783
-
Hello Dagster experts, I have an industrial use case where a dagster job is split into two set of ops, with one type of ops requiring much larger resources than the second type (typically 32 threads vs 1 thread). However, resources seem to be defined once for the full job. Is it possible somehow to define the resources for each ops instead? Thank you by advance |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
I think this would require the ECS task executor in this feature request: #9671 |
Beta Was this translation helpful? Give feedback.
I think this would require the ECS task executor in this feature request: #9671