Census processor

===

Background

The Portuguese census data is published on the INE website in a series of Excel files. Though it is rather detailed - aggregated to the freguesia (parish) level - the format is not machine readable. This script will take any question from the census and processes it into a denormalized CSV. It will also produce the datapackage.json to describe the dataset.

This script was initially built for the Views on Lisbon project, but then made more general to be able to use it with any census issue.

Limitations

The first version only processes totals.

Usage

The script needs one argument to work: the question ID.

bash xxx.sh _$id_

for example:

bash xxx.sh 605

Requirements