Skip to main content
Release date: March 22, 2023 Component versions:
ComponentVersion
Solrfusion-solr 5.8.0 (based on Solr 9.1.1)
ZooKeeper3.7.1
Spark3.2.2
KubernetesGKE, AKS, EKS 1.24 Rancher (RKE) and OpenShift 4 compatible with Kubernetes 1.24 OpenStack and customized Kubernetes installs not supported. See Kubernetes support for end of support dates.
Ingress ControllersNginx, Ambassador (Envoy), GKE Ingress Controller Istio not supported.
More information about support dates can be found at Lucidworks Fusion Product Lifecycle.
Looking to upgrade?See Fusion 5 Upgrades for detailed instructions.
Rosette Entity Extractor (REX) or Rosette Base Linguistics (RBL) for the Use Advanced Linguistics with Babel Street are not compatible with Solr 9 included in this version of Fusion. If you rely on the Babel Street language module, do not upgrade until this compatibility issue is resolved.

​
New Features

  • Managed Fusion only: Added a new feature called Dynamic Pricing which improves scalability for custom pricing. This feature lets B2B organizations with large product and pricing inventories sort, facet, boost, and filter on custom prices and entitlements.

Dynamic Pricing

The course for Dynamic Pricing focuses on how Dynamic Pricing maximizes custom pricing strategies.
  • Managed Fusion only: Fusion now supports Reverse Search, which lets you set up monitoring queries that automatically include new documents. Instead of running a query multiple times to see if new documents have been added, this feature matches incoming documents to existing relevant queries, improving content awareness and productivity.
  • Tika Asynchronous Parsing improves document crawl speeds and prevents memory and stability issues during connector processes. You can Use Tika Asynchronous Parsing to separate document crawling from document parsing, which is useful for large sets of complex documents. For more information, see Asynchronous Tika Parsing.
This document describes how to set up your application to use Tika asynchronous parsing.Unlike synchronous Tika parsing, which uses a parser stage, asynchronous Tika parsing is configured in the datasource and index pipeline. For more information, see Asynchronous Tika Parsing.
Field names change with asynchronous Tika parsing.In contrast to synchronous parsing, asynchronous Tika parsing prepends parser_ to fields added to a document. System fields, which start with \_lw_, are not prepended with parser_. If you are migrating to asynchronous Tika parsing, and your search application configuration relies on specific field names, update your search application to use the new fields.

​
Configure the connectors datasource

  1. Navigate to your datasource.
  2. Enable the Advanced view.
  3. Enable the Async Parsing option. Enable async option
    Fusion 5.9.11 and later uses your parser configuration when using asynchronous parsing.The asynchronous parsing service performs Tika parsing using Apache Tika Server. In Fusion 5.8 through 5.9.10, other parsers, such as HTML and JSON, are not supported by the asynchronous parsing service. By enabling asynchronous parsing, the parser configuration linked to your datasource is ignored. In Fusion 5.9.11 and later, other parsers, such as HTML and JSON, are supported by the asynchronous parsing service. By enabling asynchronous parsing, the parser configuration linked to your datasource is used.
  4. Save the datasource configuration.

​
Configure the parser stage

You must do this step in Fusion 5.9.11 and later.
  1. Navigate to Parsers.
  2. Select the parser, or create a new parser.
  3. From the Add a parser stage menu, select Apache Tika Container Parser.
  4. (Optional) Enter a label for this stage. This label changes the names from Apache Tika Container Parser to the value you enter in this field.
  5. If the Apache Tika Container Parser stage is not already the first stage, drag and drop the stage to the top of the stage list so it is the first stage that runs.

​
Configure the index pipeline

  1. Go to the Index Pipeline screen.
  2. Add the Solr Partial Update Indexer stage.
  3. Turn off the Reject Update if Solr Document is not Present option and turn on the Process All Pipeline Doc Fields option: Tika config setup
  4. Include an extra update field in the stage configuration using any update type and field name. In this example, an incremental field docs_counter_i with an increment value of 1 is added: Tika config setup
  5. Enable the Allow reserved fields option: Tika config setup
  6. Click Save.
  7. Turn off or remove the Solr Indexer stage, and move the Solr Partial Update Indexer stage to be the last stage in the pipeline. Tika config setup
Asynchronous Tika parsing setup is now complete. Run the datasource indexing job and monitor the results.
The Apache Tika and Forked Tika stages are now deprecated. Follow the migration steps to begin using asynchronous parsing.

​
Improvements

  • Improved recoverability for on-prem connectors in high network traffic environments.
  • Fusion’s custom Solr image has been updated to fusion-solr 5.8.0. This upgrade includes the benefits and new features in Solr 9, while also including custom plugins to support Dynamic Pricing, Reverse Search, and autoscaling.
  • Developed new authentication methods for the MongoDB connector.

​
Bug Fixes

​
Fusion

  • Fixed a bug where the indexing service failed to load some classes from some JDBC drivers.
  • Updated the Helm charts used when deploying Prometheus, Grafana, Loki, and Promtail for monitoring.
  • Fixed an error with permissions required for the Upload Model Parameters To Cloud job.
  • Graph Security Trimming stage now works when collections have multiple shards and replicas.
  • Fixed a bug where having the same document updated twice in the same job could cause the job to hang.
  • Fixed an issue where the Solr API was unable to pass through raw requests using the proxy.
  • Updated the query pipeline and indexing container base images to use Java 11 so they are more secure.
  • Removed UI link to view logs dashboard as its target screen is no longer available.
  • Fixed a UI bug where zone display fields could not be manually removed.
  • Fusion panel text editors can now scroll as expected in Firefox.

​
Predictive Merchandiser

  • Fixed a bug in Predictive Merchandiser where templates having a higher precedence using a specified trigger phrase and facet were not appearing when that phrase was searched with that facet selected.

​
Deprecations

  • Field Parser Index Stage is no longer used by Fusion connectors. It is officially deprecated in this release and will be removed entirely in a later release.
  • Streaming documents to the /index and /reindex endpoints of the Index Pipelines APIis deprecated and will eventually stop working altogether in the continuing switch to asynchronous parsing.
  • Tika Server Parser is deprecated and will be replaced by Tika Asynchronous Parser.
  • Apache Tika Parser stage is deprecated and will be removed in a later release.
  • The Forked Apache Tika Parser stage is deprecated and will be removed completely in a later release.

​
Known issues

  • New Kerberos security realms cannot be configured successfully in this version of Fusion.
  • When using the JavaScript query stage to query Solr, you have to provide parameters including rows. Previously rows accepted an integer, but now it must be entered as a string as in ("rows", "1").
map.put("q", 'okta_uid_s:"{identifier}" OR username_s:"{identifier}" OR email_s:"{identifier}"'
    .replace(/{identifier}/ig, userIdentifier))
map.put("rows", "1")