v2.0.1

2.0.1 (2022-10-19)

What's Changed

• ThreadPoolExecutor concurrent & parallel s3 files upload by @ome9ax in #84

Full Changelog: 2.0.0...2.0.1

v2.0.0

2.0.0 (2022-09-29)

What's Changed

⚠️ 🚨 BREAKING COMPATIBILITY: Python 3.8 SUPPORT REMOVED 🚨 ⚠️

• [target-core] Move the core features and functions in common shared target-core package by @ome9ax in #35

All the core stream processing functionalities are combined into target-core.

target-core core functionalities

• The stream processing library is using asyncio.to_thread introduced in Python 3.9.
• Better isolation architecture comes now by design between singer stream protocol and output custom processing. This opens for more native processing modularity and flexibility (API, S3, ...).
• Uses sys.stdin.buffer input reader over sys.stdin for more efficient input stream management.

target-s3-jsonl changes

• version ">=2.0" developments will continue under Python 3.9 and above.
• version "~=1.0" will keep living under the legacy-v1 branch.
• Optimised memory and storage management: files are uploaded asynchronously and deleted on the fly, no longer all at once at the end.

Config file updates

• changes (those will be automatically replaced during the deprecation period for backward compatibility):
  • path_template replaces naming_convention (deprecated). Few changes as well in the path_template syntax:
    • {date_time} replaces {timestamp} (deprecated).
    • {date_time:%Y%m%d} replaces {date} (deprecated).
  • work_dir replaces temp_dir (deprecated).
• New option file_size for file partitioning by size limit. The path_template must contain a part section for the part number. Example "path_template": "{stream}_{date_time:%Y%m%d_%H%M%S}_part_{part:0>3}.json".

Full Changelog: 1.2.2...2.0.0

v1.2.2

1.2.2 (2022-09-01)

What's Changed

• #69 decimal.DivisionImpossible raised when handling schema items with high levels of precision by @ome9ax in #75

Full Changelog: 1.2.1...1.2.2

v1.2.1

1.2.1 (2022-07-18)

What's Changed

• #56 Added optional config parameter role_arn, which allows assuming additional roles. by @haleemur

v1.2.0

What's Changed

• Upgrade version to 1.1.0: changelog by @ome9ax in #33
• [jsonschema] Remove the deprecated custom exception to Handle multipleOf overflow fixed in jsonschema v4.0.0 by @ome9ax in #34
• [jsonschema] remove validation exception catching by @ome9ax in #36
• [persist_lines] save_records argument by @ome9ax in #37

Full Changelog: 1.1.0...1.2.0

v1.1.0

What's Changed

• [Python] Advanced string formatting by @ome9ax in #31
• Upgrade version to 1.1.0 by @ome9ax in #32

Full Changelog: 1.0.1...1.1.0

v1.0.1

What's Changed

• [s3 upload] follow boto3 args order by @ome9ax in #18
• [dependabot] Initial Configure dependabot to update pip packages versions by @ome9ax in #21
• Bump boto3 from 1.18.22 to 1.21.24 by @dependabot in #22
• Bump jsonschema from 3.2.0 to 4.4.0 by @dependabot in #23
• [Python] introduce 3.10 by @ome9ax in #24
• [Python] 3.8 test by @ome9ax in #25
• [Python] remove requirement.txt in favour of setup.cfg as single source of truth by @ome9ax in #26
• [Github Actions] bring back requirements.txt by @ome9ax in #28
• Bump boto3 from 1.21.24 to 1.21.33 by @dependabot in #29
• Update version to 1.0.1 by @ome9ax in #30

New Contributors

• @dependabot made their first contribution in #22

Full Changelog: 1.0.0...1.0.1

v1.0.0

1.0.0 (2021-08-18)

Full Changelog

Closed issues:

• release version 1.0.0 bump 🥳🥂🍾 tests & spec, 100% complete coverage

Merged pull requests:

• [coverage] release version 1.0.0 bump 🥳🥂🍾 tests & spec, 100% complete coverage

0.0.7 (2021-08-18)

Full Changelog

Closed issues:

• Much more specs and tests, coverage increased to 98.09%

Merged pull requests:

• [coverage] tests & spec, 98.09% further coverage

v0.0.6

Closed issues:

• replace io.TextIOWrapper(sys.stdin.buffer, encoding='utf-8') with sys.stdin as it's already natively defined as <_io.TextIOWrapper name='<stdin>' mode='r' encoding='utf-8'>
• Much more specs and tests, coverage increased to 96.91%

Merged pull requests:

• [coverage] bump version 0.0.6 changelog update: Much more specs and tests, coverage increased to 96.91%
• [readlines] replace io.TextIOWrapper(sys.stdin.buffer, encoding='utf-8') with sys.stdin

v0.0.5.1

v0.0.5.1 (2021-08-09)

Full Changelog

Fixed bugs:

• Issue to decompress archived files

Closed issues:

• See PR

Merged pull requests:

• [compression] fix compression management