Tasks: Data maintenance

TO DO: Add more detail.

Regularly

• Check the status and warnings for scrapers
• Check the consistency of the database

Quarterly

• Check the Represent data request progress spreadsheet for manual requests
• ocd-division-ids
• represent-canada-data (Troubleshooting)
• scrapers-ca
• Run ./manage.py mappings and ./manage.py checkmappings from scrapers_ca_app

Annually

• Purchase postal code centroids and run loadpostcodes
• Check for updates to postal code concordances and run loadpostcodeconcordance

Expected output

Some of the maintenance tasks return output that is expected and requires no action.

invoke definitions

Richmond, NS districts                                       Expected slug to be Richmond districts not Richmond, NS districts
Paroisse de Plessisville districts                           Expected slug to be Plessisville districts not Paroisse de Plessisville districts
ocd-division/country:ca/csd:2425213/borough:1                unknown name: check slug and domain manually
ocd-division/country:ca/csd:2425213/borough:2                unknown name: check slug and domain manually
ocd-division/country:ca/csd:2425213/borough:3                unknown name: check slug and domain manually
Hamilton wards                                               Non-unique values
Newfoundland and Labrador electoral districts (2006)         Expected LICENSE.txt to match "all rights reserved" template
Newfoundland and Labrador electoral districts                Expected LICENSE.txt to match "all rights reserved" template
Quebec electoral districts                                   Expected authority to be Her Majesty the Queen in Right of Quebec not Directeur général des élections du Québec

invoke urls

302 http://chathamkentopendata.chatham-kent.opendata.arcgis.com/datasets/1f4428dd5d764320b4246d190cfb70cb_0
404 https://www.geosask.ca/
404 https://www.geosask.ca/Portal/jsp/terms_popup.jsp