-
Notifications
You must be signed in to change notification settings - Fork 6
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[changelog] changelog 0.0.5 update (#11)
- Loading branch information
Showing
1 changed file
with
11 additions
and
14 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,24 +1,21 @@ | ||
# Change Log | ||
|
||
## [HEAD] | ||
## [v0.0.5](https://github.com/ome9ax/target-s3-jsonl/tree/v0.0.5) (2021-08-12) | ||
|
||
**Fixed bugs:** | ||
- NA | ||
|
||
**Closed issues:** | ||
- NA | ||
**New features:** | ||
- I now store the rows in an Array on memory, and unload the Array into the file by batches. By default the batch size is 64Mb configurable with the `memory_buffer` config option. | ||
- I also extended the compression config option to the `lzma` compression algorithm, storing the output file under the .xz extension. | ||
- Update the message parsing to handle the metadata through the `add_metadata_columns` config option according to the [stitch documentation](https://www.stitchdata.com/docs/data-structure/integration-schemas#sdc-columns). | ||
- `timezone_offset` config option added to use `utc` timestamp in the `naming_convention` | ||
- `local` configuration option to store the data on `tmp_dir` local dir without uploading to `s3` | ||
- More specs and tests | ||
|
||
**Merged pull requests:** | ||
- [[File load buffer] unload the data from a 64Mb memory buffer](https://github.com/ome9ax/target-s3-jsonl/pull/8) | ||
- [[Metadata] manage tap Metadata _sdc columns according to the stitch documentation](https://github.com/ome9ax/target-s3-jsonl/pull/9) | ||
|
||
## [v0.0.4](https://github.com/ome9ax/target-s3-jsonl/tree/v0.0.4) (2021-08-09) | ||
[Full Changelog](https://github.com/ome9ax/target-s3-jsonl/tree/v0.0.0...v0.0.0) | ||
|
||
**Fixed bugs:** | ||
- NA | ||
|
||
**Closed issues:** | ||
- NA | ||
|
||
**Merged pull requests:** | ||
- NA | ||
**New features:** | ||
- Initial release |