0.75.0

Added:

• py: added python datetime module by default in #629
• qsvdp (Datapusher+ optimized binary variant): added self-update. However, unlike qsv and qsvlite binary variants, qsvdp will not automatically prompt for a self-update, and will only inform the user if there is a new release. The user will need to invoke the --update option explicitly. #622

Changed:

• stats: Speedup type checking by @kindly in #625
• validate: Added a useful note about validate output by @aborruso in #624
• luau: Now precompiles all scripts, including the --prologue & --epilogue scripts, into bytecode e97c2ca
• frequency: remove unsafe from_utf8_unchecked 16642e8
• More robust autoindexing in #623
• minor clippy performance tweaks to rust-csv fork
• Bump serde from 1.0.147 to 1.0.148 by @dependabot in #620
• cargo update bump several indirect dependencies
• improved README; use ❇️ to indicate commands behind a feature flag
• pin Rust nightly to 2022-11-30

New Contributors

• @aborruso made their first contribution in #624
• @kindly made their first contribution in #625

Full Changelog: 0.74.0...0.75.0

0.74.0

Added:

• safenames: added --verify and --verbose modes in #610 and #615

Changed:

• excel: align --safenames option to safenames command in #611 and #616
• luau: Now precompiles main script to bytecode; now allow loading luau script from file for main, prologue and epilogue scripts in #619
• sniff: increase default sample size from 100 to 1000 in 40d52cf
• validate: applied various optimizations in bfed127 and 06c109a
• updated Github Actions workflows to reflect removal of luajit feature
• Bump sysinfo from 0.26.7 to 0.26.8 by @dependabot in #614
• Bump rust_decimal from 1.26.1 to 1.27.0 by @dependabot in #617
• cargo bump update several indirect dependencies
• applied various clippy recommendations
• pin Rust nightly to 2022-11-25

Removed:

• luajit: removed as its been deprecated by optimized luau command which now support precompiling to bytecode, largely obviating the main feature of LuaJIT - Just-in-Time compilation in #619

Full Changelog: 0.73.2...0.74.0

0.73.2

Changed:

• Link to tests as examples from usage text in #608
• Bump serde_json from 1.0.88 to 1.0.89 by @dependabot in #607
• cargo update bump to get latest crossbeam crates to replace yanked crates 5108a87

Full Changelog: 0.73.1...0.73.2

0.73.1

Changed:

• rename safename command to safenames for consistency
• cargo update bump indirect dependencies

Full Changelog: 0.73.0...0.73.1

0.73.0

Added

• safenames: new command to modify header names to db-safe names in #606
• apply: added censor-count operation in #599
• apply: added escape operation in #600
• excel: added --safe-names option in #598

Changed

• apply: refactored to use enums instead of strings for operations in #601
• fetch & fetchpost: --http-header -H shortcut in #596
• excel: smarter date parsing for XLSX files; rename --safe-column-names to --safe-names in #603
• Smarter safe names in #605
• Bump uuid from 1.2.1 to 1.2.2 by @dependabot in #594
• Bump mimalloc from 0.1.31 to 0.1.32 by @dependabot in #595
• Bump censor from 0.2.0 to 0.3.0 by @dependabot in #597
• Bump Swatinem/rust-cache from 1 to 2 by @dependabot in #602
• cargo update bump several indirect dependencies
• pin Rust nightly to 2022-11-19

Full Changelog: 0.72.0...0.73.0

0.72.0

Added

• apply: added --keep-zero-time option in #590
• lua and luajit: added --prologue & --epilogue options in #592
• luau & luajit: switched from Lua to Luau; added special vars _idx and _rowcount in #593
• luau & luajit: return exitcode 1 if interpretation error is encountered 655041b

Changed

• schema & validate: expand description/usage text in 60dfebc
• validate: return exitcode 0 if CSV is valid; exitcode 1 otherwise in #591
• Bump hashbrown from 0.12.3 to 0.13.1 by @dependabot in #586
• cargo bump update indirect dependencies, notably chrono from 0.4.22 to 0.4.23
• Shortened command descriptions for luau & luajit and added salient notes to new interpreter section
• adjust GitHub Actions workflows to use luau feature
• pin Rust nightly to 2022-11-14

Full Changelog: 0.71.1...0.72.0

0.71.1

Changed

• python feature is no longer enabled in the prebuilt binaries to avoid distribution issues and qsv panicking if the exact python version it was statically linked against is not available. If you require the python feature, you'll have to install/build from source.

Fixed

• whirlwind tour: join's --no-case option has been replaced by --ignore-case by @alperyilmaz in #585

New Contributors

• @alperyilmaz made their first contribution in #585

Full Changelog: 0.71.0...0.71.1

0.71.0

Added

• apply: new encode and decode operations in #569
• apply: add ability to show confidence to whatlang language detection in #579
• count: add --width option in #582
• fetch & fetchpost: Added --user_agent option by @minhajuddin2510 in #565 and f59bd85
• Documented Homebrew installer 🚀 created by @FnControlOption

Changed

• apply: refactor operations validation in #564 and f83ec6f
• sortcheck: expand usage text and use fail_clierror macro 8513b53
• stats: minor refactoring 3879513
• tojsonl: it does "smart" conversion of CSV to JSONL af98290
• validate: also show --progressbar when doing schemaless validation aae550a
• only show enabled commands in command list in #583
• Updated the benchmark script by @minhajuddin2510 in #581
• Switch back to using num_cpus for detecting parallelism b7dbed8
• qsv now links against Python 3.11 for the py command in #576
• Bump robinraju/release-downloader from 1.5 to 1.6 by @dependabot in #568
• Bump newline-converter from 0.2.0 to 0.2.1 by @dependabot in #567
• Bump sysinfo from 0.26.5 to 0.26.7 by @dependabot in #566 and #572
• Bump ahash from 0.8.0 to 0.8.1 by @dependabot in #575
• Bump flexi_logger from 0.24.0 to 0.24.1 by @dependabot in #574
• Bump pyo3 from 0.17.2 to 0.17.3 by @dependabot in #573
• Bump jql from 5.1.1 to 5.1.2 by @dependabot in #577
• Bump num_cpus from 1.13.1 to 1.14.0 by @dependabot in #580
• Bump mimalloc from 0.1.30 to 0.1.31
• Bump indicatif from 0.17.1 to 0.17.2
• cargo update bump several indirect dependencies
• updated rustfmt.toml with comment and string formatting options
• bump MSRV to 1.65.0
• pin Rust Nightly to 2022-11-07

Full Changelog: 0.70.0...0.71.0

0.70.0

Added

• apply: additional operations - squeeze0, strip_prefix and strip_suffix #518 & #519
• apply: add calcconv subcommand, which parses & evaluate math expressions, with support for units & conversions. #560

Changed

• search & searchset: make match count optional #526
• jsonl: remove panic and do proper error handling; add --ignore-errors option #531
• py: py command does not do aggregations (reduce) operations #548
• lua & luajit can do aggregations across CSV rows and py cannot #549
• py: add more complex f-string formatting example #556
• Standardize ignore case option #535
• Use rustfmt nightly to take advantage of advanced features like StdExternalCrate #514 & #517
• Update benchmark-basic.sh by @minhajuddin2510 in #542
• Use fail macros more consistently #545
• Use Redis ahash feature for performance
• Added wix file for future Windows Installer by @minhajuddin2510 in #546
• Bump console from 0.15.1 to 0.15.2 by @dependabot in #512
• Bump pyo3 from 0.17.1 to 0.17.2 by @dependabot in #522
• Bump jql from 5.0.2 to 5.1.0 by @dependabot in #521
• Bump titlecase from 2.2.0 to 2.2.1 by @dependabot in #534
• Bump itoa from 1.0.3 to 1.0.4 by @dependabot in #533
• Bump sysinfo from 0.26.4 to 0.26.5 by @dependabot in #554
• Bump mlua from 0.8.3 to 0.8.4 by @dependabot in #540
• Bump uuid from 1.1.2 to 1.2.1 by @dependabot in #539
• Bump flexi_logger from 0.23.3 to 0.24.0 by @dependabot in #538
• Bump serde_json from 1.0.85 to 1.0.86 by @dependabot in #537
• Bump actions/setup-python from 4.2.0 to 4.3.0 by @dependabot in #541
• Bump filetime from 0.2.17 to 0.2.18 by @dependabot in #559
• Bump redis from 0.21.6 to 0.22.1 by @dependabot in #555
• Bump cached from 0.39.0 to 0.40.0 by @dependabot in #561
• Bump whatlang from 0.16.1 to 0.16.2 by @dependabot in #562
• cargo update bump several indirect dependencies
• Pin Rust nightly to 2022-10-22

Fixed

• excel: xls float temporary workaround for #516 that was ultimately fixed in PR 558 #520
• tojsonl: escape newlines and double quotes. Fixes #552 #553
• tojsonl: better error handling; when checking stdin for utf8, make sure its not empty. Fixes #530 #536

Removed

• excel: removed xls float workaround now that calamine crate has been fixed. Fixes #516 removing need for PR 520 workaround. #558
• removed obsolete Rust Nightly workflow 2a99318

New Contributors

• @minhajuddin2510 made their first contribution in #542

Full Changelog: 0.69.0...0.70.0

0.69.0

Added

• luajit: new command using LuaJIT, which is much faster than Lua #500

Changed

• python: tweaks. Expanded usage text. Only show python version when logging is on. #507
• fetch & fetchpost: apply clippy recommendation dd7220b
• excel: use winfo! macro 7211ff2
• Removed anyhow dependency #508
• Bump actions/stale from 5 to 6 by @dependabot in #505
• Bump sysinfo from 0.26.3 to 0.26.4 by @dependabot in #510
• Cargo update bump several indirect dependencies
• include Python 3.10 shared libraries when publishing for select platforms
• bump MSRV to Rust 1.64.0
• Pin Rust nightly to 2022-09-26

Fixed

• python: corrected erroneous --helper example. Included hashhelper.py example.
• extsort: fixed --help bug (#506)

Full Changelog: 0.68.0...0.69.0