Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#1043 add map_index_template, fix name->item bug from #1035 #1072

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

gabrielwol
Copy link
Collaborator

@gabrielwol gabrielwol commented Sep 10, 2024

What this pull request accomplishes:

  • Now that Morbius Airflow is upgraded past 2.9.3 we can implement named mapped tasks (map_index_template)
  • See successful test in gcc_pull_layers_bigdata. ✅ (tested without unnecessary update of GIS tables by commenting out parts of pull_layer).
  • Also fixed small bug from 1032 move gcc puller tables to airflow variable #1035 (dag_name -> item).

Issue(s) this solves:

What, in particular, needs to reviewed:

What needs to be done by a sysadmin after this PR is merged

Update DAG link in Morbius.

@gabrielwol gabrielwol self-assigned this Sep 10, 2024
@gabrielwol gabrielwol force-pushed the 1043-add-mapped-task-names-to-gcc_puller-after-morbius-airflow-upgrade branch from 6aa6aeb to 4e8ed3e Compare October 7, 2024 16:20
@gabrielwol gabrielwol force-pushed the 1043-add-mapped-task-names-to-gcc_puller-after-morbius-airflow-upgrade branch from 4e8ed3e to c5becfb Compare October 7, 2024 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add mapped task names to gcc_puller after Morbius Airflow upgrade
1 participant