v0.0.26 - Better RDDs, EDN Support and Data-Oriented Schemas
Pre-release
Pre-release
anthony-khong
released this
09 Sep 01:55
·
124 commits
to develop
since this release
- Schema option for read functions: all read functions now support a
:schema
option, which can be an actual Spark schema or its data-oriented version. - Basic support for EDN:
read-edn!
andwrite-edn!
are now available with an added dependency ofmetosin/jsonista
. The functions may not be performant, but can come in handy for small-data compositions. - More RDD functions: this closes the RDD function gaps to sparkplug and adds variadicity to functions that take in more than one RDDs.
- RDD name unmangling: this follows sparkplug model of unmangling RDD names after each transformation.
- Version bump for dependencies:
nrepl
bumped to 0.8.1.