public-datasets-pipelines v2.6.0

Datasets

• Onboard Austin Waste dataset (#200) (79dbf5d)
• Onboard BLS dataset (#201) (c7cdd82)
• Onboard Chicago Crime dataset (#199) (d766547)
• Onboard Sunroof Solar dataset (#166) (375cbae)
• Onboard World Bank Intl Education dataset (#182) (ff384fd)
• Onboard World Bank WDI dataset (#198) (cbad321)

Bug Fixes

• Set location field as required for GCS buckets (#224) (bd8a3db)

public-datasets-pipelines v2.5.0

Datasets

• Onboard Iowa Liquor Sales dataset (#193) (06848c8)
• Onboard San Francisco Bikeshare Station dataset (#191) (0707012)
• Onboard San Francisco Bikeshare Status dataset (#192) (e4e1f26)
• Onboard San Francisco Film Locations dataset (#190) (2284e09)

Bug Fixes

• Combine san_francisco_bikeshare_* folders into san_francisco_bikeshare (#211) (50e4e6d)
• Rename san_francisco_311_service_requests folder to san_francisco_311 (#209) (697f7be)

public-datasets-pipelines v2.4.0

Datasets

• Onboard Austin Crime dataset (#174) (b4fbaad)
• Onboard CMS Medicare dataset (#185) (d0425cd)
• Onboard COVID-19 Google Mobility dataset (#177) (1653a8e)
• Onboard New York datasets: 311 Service Requests, Citibike Stations, and Tree Census (#167) (d1f1d7c)
• Onboard San Francisco 311 Service Requests dataset (#184) (a8ba2e9)
• Onboard San Francisco Street Trees dataset (#176) (7da5061)
• Onboard World Bank Health Population dataset (#178) (4aba767)
• Onboard World Bank International Debt dataset (#179) (5ebbabb)

Features

• Support specifying an alternate BQ dataset_id for BQ tables (#203) (9115e82)

public-datasets-pipelines v2.3.1

Bug Fixes

• Delete temp GCS objects generated by gsutil's parallel composite upload for geos_fp dataset (#195) (f307cce)
• Use patched flask-openid version to fix failing builds (#188) (1ea15a0)

public-datasets-pipelines v2.3.0

Datasets

• Onboard google_political_ads.advertiser_geo_spend dataset (#154) (2201ebe)
• Onboard Austin Bikeshare dataset (#156) (0bd5659)
• Onboard NOAA's GSOD Stations and Lightning Strikes datasets (#158) (8371856)

Features

• Support Dataflow operator and job requirements (#153) (119f8fb)

public-datasets-pipelines v2.2.0

Datasets

• Onboard COVID19-Italy dataset (#148) (f56b5f2)
• Onboard GEOS-FP dataset (#130) (d32f46b)
• Onboard Google CFE dataset (#146) (9bca8ef)
• Onboard Google Political Ads dataset (#149) (5903253)
• Onboard IRS 990 dataset (#150) (1105eed)

Bug Fixes

• Regenerate Terraform files for Google Political Ads (#152) (102f8e5)
• shared_variables.json should not be reset when deploying (#147) (a6754df)

public-datasets-pipelines v2.1.0

Datasets

• Onboard Google Cloud Release Notes dataset (#133) (5c98c05)

Bug Fixes

• Revised Airflow DB initialization command (#141) (47b4717)

public-datasets-pipelines v2.0.0

⚠ BREAKING CHANGES

• Pipeline YAML template using Airflow 2 operators (#138)
• Adds support for Airflow 2 Cloud Composer environment and operators (#134)

Features

• Adds support for Airflow 2 Cloud Composer environment and operators (#134) (b2749c6)
• Pipeline YAML template using Airflow 2 operators (#138) (90ae7cd)

public-datasets-pipelines v1.11.0

Features

• Adds Google license header bot config (#106) (d587689)
• Use a single file for shared Airflow variables (#122) (f5d227d)

public-datasets-pipelines v1.10.0

Datasets

• Onboard USA names dataset (#96) (eb28f0f)