dbt-bigquery v1.9.0

dbt-bigquery 1.9.0 - December 09, 2024

Breaking Changes

• Drop support for Python 3.8 (#1373)

Features

• Add configuration options enable_list_inference and intermediate_format for python models (#1047, #1114)
• Add tests for cross-database cast macro (#1214)
• Cross-database date macro (#1221)
• add is_retryable test case when raise ServiceUnavailable (#682)
• Add support for base 64 encoded json keyfile credentials (#923)
• Add support for cancelling queries on keyboard interrupt (#917)
• Adds the ability to set optional quota_project in profile (#1343, #1344)
• Add Microbatch Strategy to dbt-spark (#1354)

Fixes

• Drop intermediate objects created in BigQuery for incremental models (#1036)
• Fix null column index issue during dbt docs generate for external tables (#1079)
• make seed delimiter configurable via field_delimeter in model config (#1119)
• Default enableListInference to True for python models to support nested lists (#1047, #1114)
• Catch additional database error exception, NotFound, as a DbtDatabaseError instead of defaulting to a DbtRuntimeError (#1360)
• use "direct" write for non-partitioned python model materializations (#1318)
• Cast event_time to a timestamp prior to comparing against microbatch start/end time (#1422)
• Fix issue where rate limit errors on table service calls are not retried (#1423)

Under the Hood

• Lazy load agate (#1162)
• Simplify linting environment and dev dependencies (#1291)
• Isolating distribution testing (#1290)
• Separate credentials functionality into its own module for reuse in retry and python submissions (#1391)
• Create a retry factory to simplify retry strategies across dbt-bigquery (#1395)

Dependencies

• Update pre-commit requirement from ~=3.5 to ~=3.7 (#1052)
• Update freezegun requirement from ~=1.3 to ~=1.4 (#1062)
• Bump mypy from 1.7.1 to 1.8.0 (#1064)
• Update flake8 requirement from ~=6.1 to ~=7.0 (#1069)
• Bump actions/download-artifact from 3 to 4 (#1209)
• Bump actions/upload-artifact from 3 to 4 (#1210)
• Bump ubuntu from 22.04 to 24.04 in /docker (#1247)
• Update pre-commit-hooks requirement from ~=4.5 to ~=4.6 (#1281)
• Update pytest-xdist requirement from ~=3.5 to ~=3.6 (#1282)
• Update flaky requirement from ~=3.7 to ~=3.8 (#1283)
• Update twine requirement from ~=4.0 to ~=5.1 (#1293)
• Update wheel requirement from ~=0.42 to ~=0.43 (#1304)

Contributors

• @d-cole (#917)
• @dwreeves (#1162)
• @jcarpenter12 (#1343, #1344)
• @jx2lee (#682)
• @leahwicz (#1290)
• @osalama (#1395)
• @robeleb1 (#923)
• @salimmoulouel (#1119)
• @vinit2107 (#1036)

dbt-bigquery v1.9.0rc1

dbt-bigquery 1.9.0-rc1 - December 02, 2024

Breaking Changes

• Drop support for Python 3.8 (#1373)

Features

• add is_retryable test case when raise ServiceUnavailable (#682)
• Adds the ability to set optional quota_project in profile (#1343, #1344)

Fixes

• use "direct" write for non-partitioned python model materializations (#1318)

Under the Hood

• Isolating distribution testing (#1290)
• Separate credentials functionality into its own module for reuse in retry and python submissions (#1391)
• Create a retry factory to simplify retry strategies across dbt-bigquery (#1395)

Dependencies

• Update wheel requirement from ~=0.42 to ~=0.43 (#1304)

Contributors

• @jcarpenter12 (#1343, #1344)
• @jx2lee (#682)
• @leahwicz (#1290)
• @osalama (#1395)

dbt-bigquery v1.8.3

dbt-bigquery 1.8.3 - October 17, 2024

Fixes

• Catch additional database error exception, NotFound, as a DbtDatabaseError instead of defaulting to a DbtRuntimeError (#1360)

dbt-bigquery v1.9.0b1

dbt-bigquery 1.9.0-b1 - October 02, 2024

Features

• Add configuration options enable_list_inference and intermediate_format for python models (#1047, #1114)
• Add tests for cross-database cast macro (#1214)
• Cross-database date macro (#1221)
• Add support for base 64 encoded json keyfile credentials (#923)
• Add support for cancelling queries on keyboard interrupt (#917)
• Add Microbatch Strategy to dbt-spark (#1354)

Fixes

• Drop intermediate objects created in BigQuery for incremental models (#1036)
• Fix null column index issue during dbt docs generate for external tables (#1079)
• make seed delimiter configurable via field_delimeter in model config (#1119)
• Default enableListInference to True for python models to support nested lists (#1047, #1114)
• Catch additional database error exception, NotFound, as a DbtDatabaseError instead of defaulting to a DbtRuntimeError (#1360)

Under the Hood

• Lazy load agate (#1162)
• Simplify linting environment and dev dependencies (#1291)

Dependencies

• Update pre-commit requirement from ~=3.5 to ~=3.7 (#1052)
• Update freezegun requirement from ~=1.3 to ~=1.4 (#1062)
• Bump mypy from 1.7.1 to 1.8.0 (#1064)
• Update flake8 requirement from ~=6.1 to ~=7.0 (#1069)
• Bump actions/download-artifact from 3 to 4 (#1209)
• Bump actions/upload-artifact from 3 to 4 (#1210)
• Bump ubuntu from 22.04 to 24.04 in /docker (#1247)
• Update pre-commit-hooks requirement from ~=4.5 to ~=4.6 (#1281)
• Update pytest-xdist requirement from ~=3.5 to ~=3.6 (#1282)
• Update flaky requirement from ~=3.7 to ~=3.8 (#1283)
• Update twine requirement from ~=4.0 to ~=5.1 (#1293)

Contributors

• @d-cole (#917)
• @dwreeves (#1162)
• @robeleb1 (#923)
• @salimmoulouel (#1119)
• @vinit2107 (#1036)

dbt-bigquery v1.8.2

dbt-bigquery 1.8.2 - June 20, 2024

Fixes

• Fix null column index issue during dbt docs generate for external tables (#1079)

dbt-bigquery v1.8.1

dbt-bigquery 1.8.1 - May 15, 2024

Features

• Add configuration options enable_list_inference and intermediate_format for python models (#1047, #1114)

Fixes

• Default enableListInference to True for python models to support nested lists (#1047, #1114)

dbt-bigquery v1.7.9

dbt-bigquery 1.7.9 - May 15, 2024

Features

• Add configuration options enable_list_inference and intermediate_format for python models (#1047, #1114)

Fixes

• Default enableListInference to True for python models to support nested lists (#1047, #1114)

dbt-bigquery v1.8.0

dbt-bigquery 1.8.0 - May 09, 2024

Features

• Add support for checking table-last-modified by metadata (#938)
• Support limiting get_catalog by object name (#950)
• Update base adapter references as part of decoupling migration (#1067)
• Support all types for unit testing in dbt-bigquery, expand coverage of safe_cast macro (#1090)
• Add new workflow for internal patch releases (#38)

Fixes

• Patch for json inline --show (#972)
• Lower bound of 2.11.0 for google-api-core (#979)
• Fix refresh syntax, config comparison with empty labels (#983)
• Assign the correct relation type to materialized views in catalog queries (#995)
• Fix inline comments (--) on the last line of an incremental model (#896)
• In incremental models, add dummy merge condition on source partition column when partition is required (#792)
• Support agate Integer type, test with empty seed (#1003)
• Fixed issue where materialized views were failing on re-run with minimal config parameters (#1007)
• Fix broken partition config granularity and batch_id being set to None (#1006)
• replace deterministic batch_id with uuid (#1006)
• remove json patch to leverage bigquery-python improvement (#1055)
• Fix dbt.string_literal for BQ when there are newlines (#1088)
• remove token field from connection keys (#1105)
• Remove custom query job async timeout logic as it has been fixed in bigquery-python (#1081)
• remove keyfile from _connection_keys (#1146)
• Add pandas extra for google-cloud-bigquery to pick up missing pyarrow dependency (#1152)
• Stop adding aliases to render_limited output (#1190)

Under the Hood

• Upgrade spark-bigquery Java deps for serverless to 2.13-0.34.0 (#1006)
• Primary and foreign key constraints are not enforced in BigQuery (#1018)
• Add tests for --empty flag (#1029)
• Migrate to dbt-common and dbt-adapters package (#1071)
• Add unit test for transaction semantics. (#1123)
• Update dependabot config to cover GHA (#1176)

Dependencies

• Update ddtrace requirement from ~=1.19 to ~=1.20 (#948)
• Update pre-commit-hooks requirement from ~=4.4 to ~=4.5 (#960)
• Bump mypy from 1.5.1 to 1.6.0 (#963)
• Update pre-commit requirement from ~=3.4 to ~=3.5 (#969)
• Update black requirement from ~=23.9 to ~=23.10 (#973)
• Bump mypy from 1.6.0 to 1.6.1 (#985)
• Update ddtrace requirement from ~=1.20 to ~=2.1 (#989)
• Update black requirement from ~=23.10 to ~=23.11 (#1013)
• Update pytest-xdist requirement from ~=3.3 to ~=3.4 (#1022)
• Bump mypy from 1.6.1 to 1.7.0 (#1023)
• Update ddtrace requirement from ~=2.1 to ~=2.2 (#1028)
• Update wheel requirement from ~=0.41 to ~=0.42 (#1033)
• Bump mypy from 1.7.0 to 1.7.1 (#1034)
• Update ddtrace requirement from ~=2.2 to ~=2.3 (#1035)
• Update pytest-xdist requirement from ~=3.4 to ~=3.5 (#1037)
• Update freezegun requirement from ~=1.2 to ~=1.3 (#1040)
• Update black requirement from ~=23.11 to ~=23.12 (#1056)
• get dbt-tests-adapters from dbt-adapters repo (#1077)
• hard pin ddtrace to 2.3.0 (#1141)
• Add dbt-core as a dependency to preserve backwards compatibility for installation (#1168)
• Bump dorny/paths-filter from 2 to 3 (#1179)
• Bump actions/github-script from 6 to 7 (#1180)
• Bump dbt-labs/actions from 1.1.0 to 1.1.1 (#1181)
• Bump actions/setup-python from 4 to 5 (#1182)
• Bump actions/checkout from 3 to 4 (#1183)

Security

• Pin black>=24.3 in dev-requirements.txt (#1151)

Contributors

• @b-per (#1088)
• @gmyrianthous (#979)
• @matt-winkler (#972)
• @tnk-ysk (#896, #792)

dbt-bigquery v1.8.0rc1

dbt-bigquery 1.8.0-rc1 - May 03, 2024

Fixes

• Fix dbt.string_literal for BQ when there are newlines (#1088)
• Stop adding aliases to render_limited output (#1190)

Under the Hood

• Update dependabot config to cover GHA (#1176)

Dependencies

• Bump dorny/paths-filter from 2 to 3 (#1179)
• Bump actions/github-script from 6 to 7 (#1180)
• Bump dbt-labs/actions from 1.1.0 to 1.1.1 (#1181)
• Bump actions/checkout from 3 to 4 (#1183)
• Bump actions/setup-python from 4 to 5 (#1182)

Contributors

• @b-per (#1088)

dbt-bigquery v1.7.8

dbt-bigquery 1.7.8 - May 03, 2024