Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Find population and boundary data for local authorities and health boards #18

Open
tomwhite opened this issue Mar 27, 2020 · 18 comments
Open

Comments

@tomwhite
Copy link
Owner

No description provided.

@tomwhite
Copy link
Owner Author

@tomwhite
Copy link
Owner Author

UK: https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates

Again may need some work to map from lower to upper LA or HB.

@timday
Copy link

timday commented Mar 27, 2020

I picked up a file census.csv from https://www.kaggle.com/electoralcommission/brexit-results#census.csv (free sign-in required) which at first glance looked like it contains the right area codes, at least for England. Usefully bins population into 5 year age intervals. Although have to bear in mind it's 2011 census data so a bit out of date (and folks are almost a decade older now!)

@timday
Copy link

timday commented Mar 27, 2020

UK: https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates

Again may need some work to map from lower to upper LA or HB.

The Scotland and Wales links seem obviously useful, but I'm a bit puzzled by this England one. It seems to be the "front door" to a vast quantity of good stuff... but amongst it I do not see anything with lower or upper tier area population/demographic data in a csv/spreadsheet file. There's certainly an obvious csv file with a whole of UK (no areas) population estimate timeseries, and there's a page with some maps which look like they have been produced from regional data (e.g figure 4 on https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/bulletins/annualsmallareapopulationestimates/mid2018 )... I'm somewhat mystified where that data is downloadable from though.

Ah hang on, that page has a link to "All data related to Population estimates by output areas, electoral, health and other geographies, England and Wales: mid-2018" which takes me to https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/bulletins/annualsmallareapopulationestimates/mid2018/relateddata?sortBy=title&query=&size=50 which looks like it might have something useful. (Wish I knew the terminology and hierarchy of all these different area types better!)

@tomwhite
Copy link
Owner Author

Useful thread here (also has links to geo info): https://twitter.com/geogale/status/1243173072196247557

@bheather
Copy link

bheather commented Mar 27, 2020

https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/datasets/populationestimatesforukenglandandwalesscotlandandnorthernireland

Does this help?

Excel file with matching LA codes for England Scotland and NI - wales seems a bit broken

@tomwhite tomwhite changed the title Find population data for local authorities and health boards Find population and boundary data for local authorities and health boards Mar 29, 2020
@tomwhite
Copy link
Owner Author

Resources for NI would be useful too, now that we have per LGD (local government district) breakdowns for confirmed case numbers.

@Jcamain
Copy link

Jcamain commented Apr 9, 2020

We've managed to do the mapping and I've managed to map it to both Health Board at a Scottish Level and lower levels in England, Wales, and NI and it works in my dashboard - it's currently proprietary format - but will try and save it off into excel and also will detail where it came from - pretty sure it is all ONS data ..

@nanjizal
Copy link

ONS data is not MIT? - This is why I have avoided using or trying to parse. Need to check license and make any shape data clear in this respect.

@Jcamain
Copy link

Jcamain commented Apr 16, 2020

Ok, so as a first step of tidying up my notes and doing documentation, here are the files I have used:

GeoJson Local_Health_Boards_December_2016_Full_Clipped_Boundaries_in_Wales.geojson Shape files for the Welsh Local Health Boards Open Government Licence v3.0 ONS http://geoportal.statistics.gov.uk/datasets/ons::local-health-boards-december-2016-super-generalised-clipped-boundaries-in-wales/data
Shapefile NHS_England_Regions_April_2019_EN_BUC.zi[ Shape files for the English NHS Regions Open Government Licence v3.0 ONS https://data.gov.uk/dataset/ece9c976-2f14-4cbb-b12c-866104413834/nhs-england-regions-april-2019-en-buc
Shapefile dohtrustboundary.zip Shape files for the Department of Health Boundaries Northern Ireland Open Government Licence v3.0 OpenDataNI https://data.gov.uk/dataset/0b04b46c-49af-45d5-b277-91b10937a01b/department-of-health-trust-boundaries
Shapefile SG_NHS_HealthBoards_2019.zip Shape files for the Scottish Health Boards Open Government Licence v3.0 Scottish Government SpatialData.gov.scot https://data.gov.uk/dataset/27d0fe5f-79bb-4116-aec9-a8e565ff756a/nhs-health-boards

and I have used our software to smooth the edges (polygons were massive), by using a simplify routine and then used simple names, NHSCode, NHSName, NHSPolygon, and created a simplified central point for the polygons where they weren't in existence. Then saved it out to csv (we use a proprietary format normally), hope it works! Am documenting everything else, so will do the same with my mapping from UTLA to that file.
UKNHSRegions.zip

@robchallen
Copy link

UK_covid_reporting_regions.zip

This is the shapefile I assembled from UK UTLAs, Wales LHB, Scotland LHB, and whatever NI felt like using.

also from:
https://github.com/terminological/uk-covid-datatools/blob/master/data-raw/UK_covid_reporting_regions.zip

@tomwhite
Copy link
Owner Author

tomwhite commented May 1, 2020

Thanks for sharing the shapefile @robchallen!

@downFast
Copy link

downFast commented May 6, 2020

Well, it is probably the longest way to do it but from this link we can download the boundaries then create a loop matching areacodes http://martinjc.github.io/UK-GeoJSON/ then once downloaded use this to convert topo to geojson https://mygeodata.cloud/conversion and finally https://mygeodata.cloud/map/#12191541-topo_eer

tada

@Jcamain
Copy link

Jcamain commented May 6, 2020

I've kept mine at Health Board, but then allowed for drill downs to UTLA's and STP's in England - Can finally share - I've brought in the daily death data for England as well .. Much more interesting when you also bring in Population data - some of the data is in proprietary format, but apart from the polygons, I can always export other data into excel / csv - double and triple checked the different data quality and mapping pieces - I've also posted links to where I got the relevant files on the final sheet with hyperlinks: https://cr.qlik.com/sense/app/6e00e04e-570f-4a4c-998d-673105e6243f/sheet/5b806fd9-40f1-47a0-9a18-8b50690c0d03/state/analysis

@downFast
Copy link

downFast commented May 6, 2020

I've kept mine at Health Board, but then allowed for drill downs to UTLA's and STP's in England - Can finally share - I've brought in the daily death data for England as well .. Much more interesting when you also bring in Population data - some of the data is in proprietary format, but apart from the polygons, I can always export other data into excel / csv - double and triple checked the different data quality and mapping pieces - I've also posted links to where I got the relevant files on the final sheet with hyperlinks: https://cr.qlik.com/sense/app/6e00e04e-570f-4a4c-998d-673105e6243f/sheet/5b806fd9-40f1-47a0-9a18-8b50690c0d03/state/analysis

my idea is to go here and grab the json https://coronavirus.data.gov.uk/

then the geojson will be created only once using the method above in my comment, but it's nice what you did tho

@gbugmann
Copy link

gbugmann commented Jun 4, 2020

in https://geoportal.statistics.gov.uk/datasets/ons-postcode-directory-latest-centroids you will find the centroid lat and lon for each postcode in the UK. For each postcode, the csv file also gives the AreaCode. So, you can do some searching through the file to find lat and lon.
I attach a result for the 183 area codes found in covid-19-cases-uk.csv.

AreaCode2lonlat.zip

Note that several postcodes will fall into a given area. I just picked the first I found. This may not be actually in the centre of the area. A better work would entail finding all postcodes in an area, then calculating their centre of gravity...

@jsavinc
Copy link

jsavinc commented Feb 12, 2021

UK_covid_reporting_regions.zip

This is the shapefile I assembled from UK UTLAs, Wales LHB, Scotland LHB, and whatever NI felt like using.

also from:
https://github.com/terminological/uk-covid-datatools/blob/master/data-raw/UK_covid_reporting_regions.zip

Hi @robchallen, I've been trying to find a low-resolution shapefile for Scottish Health Boards and came up blank - is it okay to use your compiled file for some research using data from National Records of Scotland? I'm looking at deaths at home in 2020 in Scotland.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants