Sourced from singer-sdk's releases.
v0.43.1 (2024-12-10)
🐛 Fixes
- #2807 Allow developers to set
RESTStream.http_method
v0.43.0 (2024-12-10)
Highlights
This release introduces a few improvements and changes to the SDK that should make it easier to work with SQL taps, REST streams, and targets.
A new SQL tap class attribute
exclude_streams
allows developers to exclude certain database schemas by default from discovery. This can speed up discovery and avoid issues when mapping types from database-internal schemas.Discovery for SQL taps should be about 35% faster now, thanks to using SQLAlchemy 2.0+ reflection features.
A new target built-in setting
process_activate_version_messages
lets users disable processing ofACTIVATE_VERSION
messages.Support for other content-types in REST streams with the new
RESTStream.payload_as_json
attribute. This should make it easier to work with APIs that expect non-JSON payloads, such as XML.The
RESTStream.rest_method
attribute is deprecated in favor ofRESTStream.http_method
.[!IMPORTANT] This release drops support for Python 3.8. Please make sure to upgrade your tap or target to support Python 3.9+.
[!NOTE] SQL taps now require SQLAlchemy 2.0+.
✨ New
- #2482 Allow SQL tap developers to auto-skip certain schemas from discovery
- #2784 Added a new built-in setting
activate_version
for targets to optionally disable processing ofACTIVATE_VERSION
messages- #2780 Numeric values are now parsed as
decimal.Decimal
in REST and GraphQL stream responses- #2775 Log a stream's bookmark (if it's avaiable) when its sync starts
- #2703 Targets now emit record count from the built-in batch file processor
- #2774 Accept a
maxLength
limit for VARCHARs- #2769 Add
versioning-strategy
to dependabot config of Cookiecutter templates- #2765 The last received Singer message is now logged when the target fails
- #2762 Support other content-types in REST streams
🐛 Fixes
- #2790 Ensure the required global folder tap settings are merged into the concrete implementation settings
- #2785 Use FS-specific
listdir
in folder tap- #2778 The path of the offending field is now printed for config validation errors
- #2770 Respect standard Singer stream metadata
table-key-properties
,replication-key
andforced-replication-method
- #2755 Safely compare UUID replication keys with state bookmarks -- Thanks
@nikzavada
!⚙️ Under the Hood
... (truncated)
Sourced from singer-sdk's changelog.
v0.43.1 (2024-12-10)
🐛 Fixes
- #2807 Allow developers to set
RESTStream.http_method
v0.43.0 (2024-12-10)
✨ New
- #2482 Allow SQL tap developers to auto-skip certain schemas from discovery
- #2784 Added a new built-in setting
activate_version
for targets to optionally disable processing ofACTIVATE_VERSION
messages- #2780 Numeric values are now parsed as
decimal.Decimal
in REST and GraphQL stream responses- #2775 Log a stream's bookmark (if it's avaiable) when its sync starts
- #2703 Targets now emit record count from the built-in batch file processor
- #2774 Accept a
maxLength
limit for VARCHARs- #2769 Add
versioning-strategy
to dependabot config of Cookiecutter templates- #2765 The last received Singer message is now logged when the target fails
- #2762 Support other content-types in REST streams
🐛 Fixes
- #2790 Ensure the required global folder tap settings are merged into the concrete implementation settings
- #2785 Use FS-specific
listdir
in folder tap- #2778 The path of the offending field is now printed for config validation errors
- #2770 Respect standard Singer stream metadata
table-key-properties
,replication-key
andforced-replication-method
- #2755 Safely compare UUID replication keys with state bookmarks -- Thanks
@nikzavada
!⚙️ Under the Hood
- #2805 Rename setting
activate_version
toprocess_activate_version_messages
- #2788 Fail early if input files to
--catalog
or--state
do not exist- #2781 Added a class method to instantiate
SQLToJSONSchema
from the tap configuration- #2566 Standardize on JSON Schema Draft 2020-12 to validate stream schemas
- #2751 Dropped support for Python 3.8
⚡ Performance Improvements
- #2793 Improved discovery performance for SQL taps
📚 Documentation Improvements
- #2796 Document how to configure nested stream maps values with environment variables in Meltano
📦 Packaging changes
- #2797 SQL taps now require SQLAlchemy 2.0+
d856fdc
chore: Release v0.43.1 (#2808)2ae5a1e
fix: Allow developers to set RESTStream.http_method
(#2807)2882731
chore: Release v0.43.0 (#2804)95a84d0
refactor: Rename setting activate_version
to
`process_activate_version_mess...fd494db
chore: pre-commit autoupdate (#2803)e2a78e9
chore: Run poetry lock
(#2802)d97871c
chore(deps): bump the actions group with 2 updates (#2801)81b3036
chore(deps): bump poetry from 1.8.4 to 1.8.5 in /.github/workflows in
the ci ...5d045ed
chore: Update template dependencies (#2798)2a6bee5
packaging: SQL taps now require SQLAlchemy 2.0+ (#2797)