Skip to content

RumbleDB 1.18.0 "Scarlet Ixora" beta

Compare
Choose a tag to compare
@ghislainfourny ghislainfourny released this 12 Apr 14:55
· 771 commits to master since this release
52a3424

Instructions to get started: https://rumble.readthedocs.io/en/latest/Getting%20started/

RumbleDB comes in 4 jars that you can pick from depending on your needs:

  • rumbledb-1.18.0-standalone.jar contains Spark already and can simply be run "out of the box" with java -jar rumbledb-1.18.0-standalone.jar with Java 8 or 11.
  • rumbledb-1.18.0-for-spark-3.X.jar (3.0, 3.1, 3.2) is smaller in size, does not contain Spark, and can be run in a corresponding, existing Spark environment either local (so you need to download and install Spark) or on a cluster (EMR with just a few clicks, etc) with spark-submit rumbledb-1.18.0-for-spark-3.X.jar

Release notes:

  • FLWOR expressions starting with a series of let are now better optimized and faster.
  • A warning with advice is issued in the command window if a group by is used in a FLWOR expression that starts with a let clause.
  • The shell will no longer exit when an error is thrown.
  • When a query cannot be executed in parallel, a more informative error message is output inviting the user to rewrite their query, instead of the raw Spark error.
  • When launching in shell or server mode, instructions are printed on the screen for next steps
  • Fixed crash in the execution of some where clauses when a join was not successfully detected and it falls back to linear execution
  • Support for context item declarations and passing an external context item value on the command line
  • By default, the date type no longer supports timezones (which are rarely used for this type, although supported by ISO 8601). This enables more optimizations (e.g., internal conversion to DataFrame DateType columns and export of datasets with dates to Parquet). Timezones on dates can be activated for those users who need them with a simple CLI argument (--dates-with-timezone yes).
  • Ctrl+C now elegantly exits the shell.