UNHCR & World Bank microdata library collector

This repository automates data collection from the UNHCR and the World Bank microdata libraries.

It uses a Python script and Github Action to run weekly.

Created by the Joint Data Center on Forced Displacement.

Quick access

Right-click and "Save link as" to download the files.

• UNHCR microdata library

• WorldBank microdata library

Data

Each microdata library has its own subfolder. The records are saved in the following format:

• metadata.csv: list of all datasets available

• datasets.csv: all information about the datasets in both microdata libraries

Code

list.py: Lists all datasets in the MDLs and creates a CSV file with the metadata

get.py: Loop through all rows in metadata.csv to get data from the datasets and generate the datasets.csv file.