Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] set the default_cluster on the workflow to NONE #151

Open
3 tasks
boggavarapu opened this issue Sep 9, 2024 · 0 comments
Open
3 tasks

[FEATURE] set the default_cluster on the workflow to NONE #151

boggavarapu opened this issue Sep 9, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers
Milestone

Comments

@boggavarapu
Copy link

Is your feature request related to a problem? Please describe.
We need to set the default_cluster on the workflow set to NONE

Cloud Information

  • [ X ] AWS
  • Azure
  • GCP
  • Other

Describe the solution you'd like
when creating a workflow with only a SQL TASK https://engineering.nike.com/brickflow/v1.1.0/tasks/#sql-task
the workflow is still expecting a default cluster

Describe alternatives you've considered
for the interim we have to create a resource within a workflow and then execute the the SQL Task

Additional context
if we can enable passing parameters to the SQLTask it would be easier

ERROR
File "/Users/SBogga/lib/python3.10/site-packages/brickflow/engine/workflow.py", line 149, in post_init
raise NoWorkflowComputeError(
brickflow.engine.workflow.NoWorkflowComputeError: Please configure default_cluster or clusters field for workflow: clickstream_session_fact_mv_create

The above exception was the direct cause of the following exception:

@boggavarapu boggavarapu added the enhancement New feature or request label Sep 9, 2024
@boggavarapu boggavarapu changed the title [FEATURE] Please add your feature request title [FEATURE] set the default_cluster on the workflow to NONE Sep 9, 2024
@asingamaneni asingamaneni added this to the v1.3.0 milestone Oct 3, 2024
@pariksheet pariksheet added the good first issue Good for newcomers label Oct 22, 2024
@pariksheet pariksheet self-assigned this Oct 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants