You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now that plant_parts_eia is dagsterized and part of the ETL, it's a bit of a bummer that it takes so long to generate. Currently, there's a loop in the creation of the table here that loops through all the different parts and concatenates a bunch of dataframes together. This could be done concurrently instead of looping to speed things up.
The text was updated successfully, but these errors were encountered:
katie-lamb
added
ppe
Plant Parts EIA (formerly the EIA plant parts list)
ccai
Tasks related to CCAI grant for entity matching
labels
Oct 5, 2023
Now that
plant_parts_eia
is dagsterized and part of the ETL, it's a bit of a bummer that it takes so long to generate. Currently, there's a loop in the creation of the table here that loops through all the different parts and concatenates a bunch of dataframes together. This could be done concurrently instead of looping to speed things up.The text was updated successfully, but these errors were encountered: