0.80.0

Added

• new to command. Converts CSVs "to" PostgreSQL, SQLite, XLSX, Parquet and Data Package by @kindly in #656
• apply: add numtocurrency operation #670
• sort: add --ignore-case option #673
• stats: now computes summary statistics for dates as well #684
• added --updatenow option, resolves #661 #662
• replace footnotes in Available Commands list with emojis 😄

Changed

• apply & applydp: expose --batch size option #679
• validate: add last valid row to validation error 7680011
• input: add last valid row to error message 492e51f
• upgrade to csvs-convert 0.7.5 by @kindly in #668
• Bump serial_test from 0.9.0 to 0.10.0 by @dependabot in #671
• Bump csvs_convert from 0.7.5 to 0.7.7 by @dependabot in #674
• Bump num_cpus from 1.14.0 to 1.15.0 by @dependabot in #678
• Bump robinraju/release-downloader from 1.6 to 1.7 by @dependabot in #677
• Bump actions/stale from 6 to 7 by @dependabot in #676
• Bump actions/setup-python from 4.3.1 to 4.4.0 by @dependabot in #683
• added concurrency check to CI tests so that redundant CI test are canceled when new ones are launched
• instead of saying "descriptive statistics", use more understandable "summary statistics"
• changed publishing workflows to enable to feature for applicable target platforms
• cargo update bump dependencies, notably qsv-stats from 0.4.5 to 0.4.6 and qsv_currency from 0.5.0 to 0.6.0
• pin Rust nightly to 2022-12-22

Fixed

• stats: fix leading zero handling #667
• apply: fix currencytonum bug #669

Full Changelog: 0.79.0...0.80.0

0.79.0

Added

• safenames: add --reserved option, allowing user to specify additional "unsafe" names #657
• safenames: add --prefix option #658
• fetch & fetchpost: added simple retry backoff multiplier - e343398

Changed

• excel: refactored --metadata processing; added more debug messages; minor perf tweaks f137bab
• set MSRV to Rust 1.6.6
• cargo update bump several dependencies, notably qsv-dateparser
• pin Rust nightly to 2022-12-15

Full Changelog: 0.78.2...0.79.0

0.78.2

Changed

• cargo update bump paste 1.0.9 to 1.0.10
• pin Rust nightly to 2022-12-12

Removed

• excel: remove --safenames option. If you need safenames, use the safenames command e5da73b

Full Changelog: 0.78.1...0.78.2

0.78.1

Changed

• qsvdp: apply now available in qsvdp asapplydp - removing the geocode and calconv subcommands, and removing all operations that require third-party crates EXCEPT dynfmt and datefmt which is needed for Datapusher+ #652
• excel: fine-tune --metadata processing 09530d4
• bump serde from 1.0.149 to 1.0.150
• qsvdp in now included in CI tests

Full Changelog: 0.78.0...0.78.1

0.78.0

Added

• stats: added leading zero handling when inferring types (e.g. zipcodes like "07094" are strings not integers) #648
• stats: added --typesonly option, which infers only data types with date inferencing enabled for all columns #650
• stats: added underflow handing to sum statistic 1b5e545
• excel: expanded --metadata functionality, with the option to return workbook metadata as JSON as well #651
• added platform-specific README for prebuilt zip archives 15e247e

Changed

• safenames: improved usage text
• stats: minor performance tweaks 88be38b and 8aa58c5
• join: minor performance tweaks 92d4191
• exclude: minor performance tweaks f3cc0ac
• sniff: minor performance tweak d2a4676
• sortcheck: minor performance tweak 83c22ae
• switch GitHub Actions to use ubuntu-20.04 so as not to link to too new glibc libraries, preventing older distros from running the linux-gnu prebuilts.
• switch GitHub Actions to use macos-12 to minimize flaky CI tests
• expanded qsvdp description in README
• Bump actions/setup-python from 4.3.0 to 4.3.1 by @dependabot in #645
• cargo update bump several indirect dependencies
• pin Rust nightly to 2022-12-10

Full Changelog: 0.77.0...0.78.0

0.77.0

Added

• safenames: added Verbose JSON options #644

Changed

• py & luau: improved usage text
• opt-in self-update in #640 and #641
• Create README in prebuilt zip archive with platform specific notes (Logic created but not implemented until next release) #642
• Simplify python map_datetime test so it works on older Python versions e85e4e7
• include date.lua in qsv package so cargo install works 11a0ff8
• Bump data-encoding from 2.3.2 to 2.3.3 by @dependabot in #638
• cargo update bump several dependencies
• pin Rust nightly to 2022-12-07

Fixed:

• safenames: fixed calculation of unsafe headers as it was dupe-counting some unsafe headers - #644

Full Changelog: 0.76.3...0.77.0

0.76.3

Changed

• cargo update bump serde from 1.0.148 to 1.0.149
• simplify python datetime test so it runs on Python 3.6 and above

Fixed

• reverted not_luau_compatible introduced in 0.76.2 and 0.76.3. Adjusted Github Action publish workflow instead to properly build luau in qsvdp when the platform supports it.

Full Changelog: 0.76.2...0.76.3

0.76.2

Fixed

• tweak not_luau_compatible feature so we can more easily disable luau feature when cross-compiling for some platforms where we cannot properly build luau.

NOTE: Not published on crates.io due to problems creating prebuilt binaries

Full Changelog: 0.76.1...0.76.2

0.76.1

Fixed

• added not_luau_compatible feature so we can more easily disable luau feature when cross-compiling for some platforms where we cannot properly build luau.

NOTE: Not published on crates.io due to problems creating prebuilt binaries

Full Changelog: 0.76.0...0.76.1

0.76.0

Added

• qsvdp: add luau in anticipation of Datapusher+ optional preprocessing #634
• luau: added ability to load libraries using "require"; preload LuaDate library #633
• luau: added more extensive debug logging support, adding _idx to debug log messages; trace log level support showing global vars and record values when an error occurs #636 and #637

Changed

• py and luau: when errors encountered, return non-zero exit code, along with error count to stderr #631
• safenames and excel: Unsafe empty column/header names are replaced with "_blank" instead of "_" #632
• frequency: replace foreach iterator with regular for; remove unneeded assert 74eb321
• bumped qsv-stats from 0.4.1 to 0.4.5 - fixing sum rounding and variance precision errors.
• cargo update bump several indirect dependencies
• pin Rust nightly to 2022-12-03

Fixed

• stats: fix sum rounding and variance precision errors #635

NOTE: Not published on crates.io due to problems creating prebuilt binaries

Full Changelog: 0.75.0...0.76.0