-
|
Can Flyte version a DAG by git commit? I would especially like to be able to use it in CI; to trigger a version not yet in master to detect model regressions. The documentation around versioning is a bit sparse.
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
We usually version every day by git commit, but it is up to you. At Lyft and a couple of other places, Flyte registration is auto-triggered from a pull request using the CI system. Then on merge to master and a deployment - the workflow is deployed through multiple domains. This provides a very CI/CD style to working with pipelines. But this is not required. In some cases when you are rapidly iterating, you can also push directly from your laptop. If you have permissions to either push a docker image or use fast register to push the code archive to s3 or equivalent. This is called fast register. |
Beta Was this translation helpful? Give feedback.
We usually version every day by git commit, but it is up to you. At Lyft and a couple of other places, Flyte registration is auto-triggered from a pull request using the CI system. Then on merge to master and a deployment - the workflow is deployed through multiple domains. This provides a very CI/CD style to working with pipelines.
But this is not required. In some cases when you are rapidly iterating, you can also push directly from your laptop.
If you have permissions to either push a docker image or use fast register to push the code archive to s3 or equivalent. This is called fast register.
@kumare3