RumbleDB 1.17.0 "Cacao tree" beta
ghislainfourny
released this
02 Feb 10:41
·
883 commits
to master
since this release
Instructions to get started: https://rumble.readthedocs.io/en/latest/Getting%20started/
- The CLI was extended with verbs (run, serve, repl) and single-dash shortcuts (-f for --output-format, etc). This is backward compatible.
- Automatic internal conversion to DataFrames for FLWOR expressions executed in parallel when the statically inferred type is DataFrame-compatible.
- Fixed bug that prevented calling a variable $type or lookup up a field called "type" without quotes.
- Fixed but for projecting a sequence internally stored as a DataFrame to dynamically defined keys.
- Fix some bugs with post-grouping count optimizations on let variables
- Support for Spark 2.4, which is no longer maintained by the Spark team, is now dropped, but available on request. RumbleDB 1.17 supports Spark 3.0, 3.1 and 3.2.
- plenty of smaller bug fixes
- [Experimental] we also provide a jar that embeds Spark and does not require its installation (rumbledb-1.17.0-standalone.jar). It is for use on a local machine only (not a cluster) and works with
java -jar rumbledb-1.17.0-standalone.jar run -q '1+1'
rather with spark-submit. Feedback is welcome! This is just experimental at this point and we will take it from there.