Fusion Server Release Notes

Latest Release: 5.0.1 (10 October 2019)

Component Versions

Fusion comes bundled with everything you need to get started.

Solr 8.2

ZooKeeper 3.4.13

Spark 2.4.3

Upgrade Instructions

To upgrade from Fusion 5.0.0 to 5.0.1 using the GKE installation script (setup_f5_gke.sh), run the following command:

./setup_f5_gke.sh -c <cluster> -r <release> -n <namespace> -p <project> -z <zone> -i <instance_type> --upgrade

To upgrade from Fusion 5.0.0 to 5.0.1 using Helm, run the following commands:

helm repo update
helm upgrade ${RELEASE} "lucidworks/fusion" --timeout 180 --namespace "${NAMESPACE}" --values "${RELEASE}_${NAMESPACE}_fusion_values.yaml"

Improvements

  • Performance is improved for the logging of the SQL service.

  • Synonym detection is improved to better handle multi-word synonyms.

Other Changes

  • The Cluster, Hosts, Services, and Datasources dashboards are removed from the DevOps center. The Log Viewer dashboard remains.

    DevOps Center Changes

  • Minor changes to the default Spark settings in Kubernetes.

Previous releases

5.0.0 (17 May 2019)

Component Versions

Solr 8.2

ZooKeeper 3.4.13

Spark 2.4.3

Lucidworks Fusion 5.0 lets customers easily deploy AI-powered data discovery and search applications in a modern, containerized architecture with built-in support for rapidly creating interactive dashboards and modern enterprise applications. Customers can leverage existing models and workflows, or create and deploy new ones quickly using popular tools like Python ML, TensorFlow, scikit-learn, and spaCy.

Kubernetes

Fusion 5.0 introduces Kubernetes (k8s), an open-source system for automating deployment, scaling, and management of containerized applications, as the recommended Fusion deployment model.

Enforcing best practices

With Kubernetes, Fusion users have a common language to declare how Fusion should be installed, configured, and maintained in production. Instead of focusing on internal implementation details, operations engineers will manage Fusion by monitoring how it uses native Kubernetes resources.

Reducing cost of ownership

Fusion with Kubernetes allows operations engineers to run Fusion, reducing the need for specialized training and internal experts.

Simplifying maintenance and upgrades

Kubernetes allows Fusion users to make zero downtime upgrades simple with rolling updates, minimizing the risks associated with changing a live cluster.

Spring Boot

Traditionally, the cross-cutting concerns of Fusion’s various microservices have been handled with a chassis built and maintained by Lucidworks. Now, Fusion 5.0 employs Spring Boot as its microservice chassis.

Whether Fusion 5.0 is being deployed in a Kubernetes, non-Kubernetes, or on-premises environment, Spring Boot allows Fusion to be deployed using the same underlying framework.

4.2.4 (3 September 2019)

Component Versions

Solr 7.7.2

ZooKeeper 3.4.13

Spark 2.3.2

Jetty 9.4.19.v20190610

Ignite 2.6.0

SharePoint Optimized and SharePoint Online Optimized Connectors

Fusion 4.2.4 introduces ground-up rewrite of our our SharePoint and SharePoint Online connectors. The new connectors, SharePoint V1 Optimized and SharePoint Online V1 Optimized offer a variety of new features and benefits, including:

  • Performance of the initial crawl and incremental crawls have been significantly improved.

  • Security trimming has been centralized so it can be shared between different connector configurations. This is handled by the Active Directory Connector for ACLs.

    SharePoint Optimized Security Trimming

  • More options are available for limiting documents.

    SharePoint Optimized Limit Docs

  • More options are available for customizing crawl performance.

    SharePoint Optimized Crawl Performance

Users are encouraged to upgrade from the classic connectors to the optimized connectors.

Active Directory Connector for ACLs

The new Active Directory Connector for ACLs indexes Active Control List (ACL) information into a configured collection so that it can be used by the SharePoint Optimized and SharePoint Online Optimized connectors.

Active Directory Connector for ACLs

Forked Apache Tika Parser

Fusion Server 4.2.4 adds a new parser, the Forked Apache Tika parser. This parser is a simplified Apache Tika parser geared towards an Enterprise Search crawl in which all documents are parsed in a forked Java Virtual Machine. If memory issues occur while parsing, such as an Out Of Memory condition, the connector job is unaffected.

Forked Tika Parser

4.2.3 (28 July 2019)

Component Versions

Solr 7.7.2

ZooKeeper 3.4.13

Spark 2.3.2

Jetty 9.4.12.v20180830

Ignite 2.6.0

  • SQL aggregations aggregations now support the use of the NOT operator inside AND or OR clauses. For example:

    FROM ${inputCollection} c
    WHERE
          ((c.type IN ('click') AND !(c.query <> '*:*')))
          OR
          (c.type IN ('cart','purchase'))
  • V2 connectors now support multivalued fields.

  • Wait times at the end of V2 connector jobs have been reduced.

  • Users can now enable or disable spell correction and tail rewrites separately in the Text Tagger stage.

    TextTagger Stage Options^