-
Notifications
You must be signed in to change notification settings - Fork 179
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Support Snowflake warehouse override without model configs #1280
Comments
@christopher-turnbull-77 Curious if there's a reason why you can't use env_vars for this? Since you could need to override the warehouse at the connection level, to me environment variables feel more appropriate for this use case. Is it simply because you want to supply the input via the command line? |
Thanks for the question! The key difference is in the use cases: env_vars are great for connection-level settings that are environment-specific (dev/prod) and shouldn't change frequently. vars are better suited for runtime configurations that might need to change between different dbt commands or job runs. The implementation doesn't remove the ability to use env_vars - it simply adds flexibility by providing another option. Users can choose whichever method best fits their workflow, whether that's env_vars for stable connection settings or vars for dynamic runtime configuration. |
@christopher-turnbull-77 Just to clarify, you want to be able to apply |
Actually, this PR serves a different purpose. While you can indeed specify warehouses in model configs today, this implementation allows for warehouse override via command-line vars without touching any model configurations. This is particularly useful during development when you might want to:
The existing model-level configuration still works - this just adds another layer of flexibility that's especially valuable during the development process. |
Makes sense - appreciate the clarification. Currently this isn't a high priority for our roadmap and I don't see us picking this up in the near future. I will leave this issue open for now to get more community feedback but wanted to set expectations. |
Is this your first time submitting a feature request?
Describe the feature
Currently, users can specify Snowflake warehouses at the model level (using config blocks) or project level (in dbt_project.yml). However, there's no way to override the warehouse at runtime without modifying these files. This feature adds support for overriding the Snowflake warehouse using dbt vars, which works for both
dbt run
anddbt test
commands.Example usage:
This provides more flexibility for users who need to dynamically change warehouses based on different scenarios (e.g., using a larger warehouse for development/testing, or a smaller one for CI/CD pipelines).
Describe alternatives you've considered
Currently, users can specify Snowflake warehouses at the model level (using config blocks) or project level (in dbt_project.yml). However, there's no way to override the warehouse at runtime without modifying these files.
Who will this benefit?
This benefits dbt-snowflake users who need to:
Are you interested in contributing this feature?
Yes
Anything else?
This extends the existing warehouse configuration functionality in a way that's consistent with dbt's var override patterns.
The text was updated successfully, but these errors were encountered: