Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#1051 delete deprecated collisions / traffic pipelines #1052

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

gabrielwol
Copy link
Collaborator

@gabrielwol gabrielwol commented Aug 28, 2024

What this pull request accomplishes:

  • Delete dags/traffic_transfer.py, dags/collisions_replicator_transfer.py and all the SQL functions / tables they maintained.
  • Fix one view that's not broken but had name inconsistent with definition in github

Issue(s) this solves:

What, in particular, needs to reviewed:

What needs to be done by a sysadmin after this PR is merged

Need to:

--these are the functions from the DAGs
DROP FUNCTION IF EXISTS collisions_replicator.refresh_mat_view_collisions_no;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_mat_views;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_ev_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_inv_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_norm_mv;
DROP FUNCTION IF EXISTS collisions_replicator.refresh_raw_fields_mv;
DROP FUNCTION IF EXISTS collisions_replicator.update_acc_safe_copy;
DROP FUNCTION IF EXISTS traffic.update_arc_link;
DROP FUNCTION IF EXISTS traffic.update_arterydata;
DROP FUNCTION IF EXISTS traffic.update_category;
DROP FUNCTION IF EXISTS traffic.update_cnt_det;
DROP FUNCTION IF EXISTS traffic.update_cnt_spd;
DROP FUNCTION IF EXISTS traffic.update_countinfo;
DROP FUNCTION IF EXISTS traffic.update_countinfomics;
DROP FUNCTION IF EXISTS traffic.update_det;
DROP FUNCTION IF EXISTS traffic.update_node;

--do not use views in traffic
DROP VIEW IF EXISTS traffic.artery_traffic_signals_DO_NOT_USE;
DROP VIEW IF EXISTS traffic.artery_locations_px_DO_NOT_USE; --this one is referenced by two DRs which we would have to deal with: data_requests.i0510_nycs_volume_tmc, data_requests.i0648_glencarin_tmc

--logged actions, no longer relevant with current truncate and delete paradigm. 
DROP TABLE IF EXISTS traffic.logged_actions;
DROP FUNCTION IF EXISTS traffic.if_modified_func();

@gabrielwol gabrielwol self-assigned this Aug 28, 2024
@gabrielwol gabrielwol linked an issue Aug 28, 2024 that may be closed by this pull request
@gabrielwol gabrielwol changed the title #1051 delete all the things #1051 delete deprecated collisions / traffic pipelines Aug 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Clean up deprecated collision & traffic replication pipelines
1 participant