Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: adds DATAHUB_REVISION acyrl-datahub-actions deployment #483

Conversation

sgomezvillamor
Copy link
Contributor

@sgomezvillamor sgomezvillamor commented Jul 1, 2024

We are deploying action recipes in k8s configmaps which are mounted as k8s volumes in the acryl-datahub-actions deployment. However, updating the configmap also requires to manually rollup the pods in the k8s deployment so new recipes are picked up.

This is adding DATAHUB_REVISION from .Release.Revision as env var to force the redeploy of acryl-datahub-actions deployment with every new deployment.

This is following same strategy as GMS, and consumer jobs.

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable)

@sgomezvillamor sgomezvillamor marked this pull request as ready for review July 1, 2024 16:17
@darnaut
Copy link
Contributor

darnaut commented Jul 1, 2024

Not sure why this needs to be an environment variable. Anyway, how to achieve the desired effect is documented at Automatically Roll Deployments.

@sgomezvillamor
Copy link
Contributor Author

sgomezvillamor commented Jul 1, 2024

Not sure why this needs to be an environment variable. Anyway, how to achieve the desired effect is documented at Automatically Roll Deployments.

I didn't know about that helm feature or common practice. Definitely, it covers my use case: force the roll up of the pods. I understand DATAHUB_REVISION somehow follows the same approach: adding a difference in the k8s object so it forces the roll up. Whether difference is env var or annotation (checksum, random number, etc) is sort of implementation detail. Anyway, thanks for sharing @darnaut !

Specifically about the DATAHUB_REVISION environment var: I noted GMS or consumer jobs were rolled up in every deploy (even if no changes in the k8s objects) while acryl datahub actions didn't. I checked up differences and the only one I found was DATAHUB_REVISION. So I understood it was introduced to build such a behaviour.

I see the env var was mostly introduced here https://github.com/acryldata/datahub-helm/pull/254/files by @david-leifker . Maybe the author can clarify if the env var was introduced with such a purpose or it just became an additional side effect.

@darnaut
Copy link
Contributor

darnaut commented Jul 1, 2024

DATAHUB_REVISION is an actual environment variable used by some DataHub components to build a version string.

@sgomezvillamor
Copy link
Contributor Author

Following @darnaut suggestion, this PR is superseded by PR #487

@sgomezvillamor sgomezvillamor deleted the feat-datahub-revision-acryl-datahub-actions branch July 22, 2024 12:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants