Skip to content

Commit

Permalink
Add rake task documentation.
Browse files Browse the repository at this point in the history
  • Loading branch information
KludgeKML committed Sep 25, 2023
1 parent cb06ed5 commit 52195db
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions docs/updating-ons-postcode-data.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# Updating ONS Postcode Data

High-quality postcode data using in Locations API comes from the Ordnance Survey. But that dataset does not include all postcodes active (for instance, it excludes large user postcodes), nor does it include historical postcodes that people may still be using. To support this, we can import lower-quality postcode information from the Office for National Statistics Postcode Directory. The system will always use the high quality data where possible, but can use the low-quality data for geolocating in imminence datasets and lookups.

The Postcode Directory is updated a couple of times a year. Every few months, someone should check to see if there is a new version of the data and update it.

- Visit https://geoportal.statistics.gov.uk/search?collection=Dataset&sort=-created&tags=all(PRD_ONSPD) to see if there is a new version.
- Visit the page for the new version. There should be a Download link on the page. Copy the URL from that link.
- On the locations-api shell, run the rake task: `rails import_ons_data[<url you copied earlier>]`

This rake task will start an OnsDownloadWorker, which downloads the file, splits out the multi-csv directory into an S3 bucket, and starts a single OnsImportWorker for each of the files.

0 comments on commit 52195db

Please sign in to comment.