v0.11.2

🐛 Fixes

• Resolve failures in is_interactive() check, resolving failures in ASGI runtimes such as FastAPI (#263) - Thanks, @rshorser!

v0.11.1

🐛 Fixes

• Improved column and table normalization logic, which resolves errors that would occur when processing stream names or property names containing special characters (#239)
• Resolve error when parsing streams that have "object or string" data typing, specifically "TypeError: unhashable type list" errors (#251)

v0.11.0

✨ New Features

• Add support for running Docker sources, via a new airbyte.experimental.get_source() method. (#209, #230) - Thanks, @Tarekk!
  • Please report any feedback in a GitHub issue or reach out in the #pyairbyte-public-beta channel in the Airbyte Slack.

⚙️ Under the Hood

• Bump to latest Snowflake client and cryptography package. (#234)
• CatalogManager refactor: decoupling sql processors, caches, and internal sql backend tables for state and catalog tracking. This also enables us to move some of these classes upstream into the CDK, so they can be used for Python destination connectors. (#220)

🧑‍🤝‍🧑 Velocity Improvements

• Add Poe task support and code coverage reporting, speeding up common tasks for contributors. (#231)
• Add /poetry-lock slash command to streamline version locking in PRs. (#236)

v0.10.5

✨ New Features

• New native merge upserts for Snowflake caches, improving performance for load operations (#203)
• Add Source.connector_version property to show what version of a connector is installed (#211)

⚙️ Under the Hood

• Internal updates to enable future Snowflake Cortex destination (#203)

v0.10.4

🐛 Fixes

• Expand default column size for non-integer number fields to DECIMAL (38, 9), resolves issues with too-large number values (#194)

v0.10.3

✨ New Features

• Add fetch_connector_secret() convenience method on GoogleGSMSecretManager. (#191)

🐛 Fixes

• Fix GSM secrets retrieval edge cases, and improve GSM CI tests. (#191)

📖 Docs

• Improve docs around 0.10.x features. (#190)

v0.10.2

🐛 Fix

• Install google secrets library as a main dependency (resolves ImportError). (#189)

v0.10.1

🐛 Fixes

• Resolve failures when loading large dataset by running Snowflake PUT queries sequentially (#188) - Thanks, @SebastienN15!

✨ New Features

• Add parse_json() convenience method on SecretHandle class. (#182)

v0.10.0

✨ New Features

This release focuses on broadening the vision of PyAirbyte, adding capabilities for Airbyte Cloud users to orchestrate their syncs using PyAirbyte. Secrets management is also significantly expanded. Lastly, we improve record parsing of problematic records thanks to a community contribution from @SebastienN15.

☁️ Cloud Interop (#143)

• Add ability to run Airbyte Cloud jobs with CloudWorkspace.run_sync(), which returns a SyncResult object.
• Add ability to check Airbyte Cloud sync statuses, wait for status, check number of records synced, etc.
• Add ability to get CachedDataset objects from completed Airbyte Cloud jobs, and read records from those final tables. (Snowflake and BigQuery only.)

🔐 Secrets Management (#143)

• Add support for "BYO secrets" using CustomSecretsManager.
• Add a new custom secrets manager for Google GSM: GoogleGSMSecretsManager.

🐛 Fixes

• Improve parsing of deeply nested records by adding a fallback json parser (#178) - Thanks, @SebastienN15!!

v0.9.0

🚀 New Features

This release adds new metadata fields to all streams, including a unique record ID (_airbyte_raw_id) and timestamp (_airbyte_extracted_at). This release also adds a feature to auto-add new columns if they are missing from cache tables.

• Add new internal Airbyte columns, aligned with Airbyte Destinations "v2" (#144)
• Auto-add missing columns to Cache tables (#144)
• New StreamRecord class and public records module (#166)

📖 Documentation Updates

• Several new topics added to reference docs (#144, #170):
  • Schema Evolution
  • Table and Field Name Normalization
  • Airbyte-Managed Metadata Columns