2.4.0 Release Notes

This release introduces the following changes:

  • Index Pipeline Simulator

    This is a powerful development tool for working with your index pipelines. It’s a sandbox where you can configure an index pipeline and preview its output before finalizing your changes. Using a temporary copy of the pipeline, you can add, remove, and configure index pipeline stages and see how they affect your indexed data.

  • Time-based partitioning

    You can now configure any Fusion collection as a moving time window using a set of Solr collections, where each Solr collection stores data from a specified time range. Time-based queries are automatically directed to the appropriate partition.

  • Spark integration improvements

    • The new Spark Jobs API lets you configure and manage Spark jobs and get Spark cluster information.

    • Fusion’s SparkContext object now provides greater flexibility for allocating resources.

  • SAML support

    Fusion now supports version 2.0 of the Security Assertion Markup Language (SAML) for access control.

  • Javascript Pipeline Stage Processing Improvements

    Fusion pipelines have been have been streamlined so that the JavaScript in a JavaScript pipeline stage need only be evaluated once, upon initial invocation of that stage. As of 2.4, all pipeline variables referenced in the body of a JavaScript function must be passed in as arguments to the function. As a result of this change, existing JavaScript code may need to be rewritten. See:

  • New location for log configuration files

    Previously, log configuration files were located in subdirectories of their Fusion components. As of 2.4, log configuration files are in the conf/ directory.

  • Deprecated Connectors

    The following Connectors are deprecated in this release. They may be re-introduced in a later release.

    • DropBox Connector

    • Logstash Connector

    • S3H Connector

    • Slack Connector

    • Twitter Search Connector

    • Twitter Stream Connector

  • Diagnostics reports

    Now you can generate diagnostic reports that the Lucidworks support team can use to diagnose issues more quickly and accurately. The support team will provide instructions for generating these reports when you need them.