Avoid installing deps in Local mode - behaviour change in 1.2.4 #715
Labels
area:config
Related to configuration, like YAML files, environment variables, or executer configuration
area:dependencies
Related to dependencies, like Python packages, library versions, etc
area:execution
Related to the execution environment/mode, like Docker, Kubernetes, Local, VirtualEnv, etc
dbt:deps
Primarily related to dbt deps command or functionality
execution:local
Related to Local execution environment
priority:high
High priority issues are blocking or critical issues without a workaround and large impact
We're using Cosmos in a regulated environment (FedRAMP) so we aren't allowed to let
dbt
install dependencies at runtime. Instead we package up the project with all the dependencies in our build pipeline and then unpack the whole thing into Airflow. We run Cosmos with the Local executor mode.The recent release 1.2.4 has broken our workflow since the dependencies are no longer being copied, and the suggested fix (to use
install_deps
- see #713 ) isn't allowed due to regulations.2b91285#diff-cdc7f3cedeca298d5c3bdd8d9be8fa15791b915fbe1b2810e9c86c271eb86446L200
This diff ⬆️ changed
copytree
intocreate_symlinks
which skips over thedbt_packages
directory.(I'm happy to contribute a fix to make this behavior configurable but would appreciate any guidance about how to best achieve this!)
The text was updated successfully, but these errors were encountered: