Fusion 5.12.0

​

Platform Support and Component Versions

​

Kubernetes platform support

• Google Kubernetes Engine (GKE): 1.28, 1.27, and 1.26
• Microsoft Azure Kubernetes Service (AKS): 1.28, 1.27, and 1.26
• Amazon Elastic Kubernetes Service (EKS): 1.28, 1.27, and 1.26

​

Component versions

​

New Features

​

Fusion

​

JSON viewer for Fusion objects

• Visualize configuration: View the complete JSON representation of the selected object’s configuration in a clear and well-formatted manner. For example, a basic datasource configuration resembles the following:
  Copy

  {
    "id": "mens-products",
    "created": "2024-02-12T15:08:29.332Z",
    "modified": "2024-02-12T15:08:29.332Z",
    "connector": "lucid.fileupload",
    "type": "fileupload",
    "pipeline": "Documentation",
    "parserId": "_system",
    "properties": {
      "collection": "Documentation",
      "fileId": "mens-products.csv",
      "mediaType": "application/octet-stream"
    }
  }
  

• Facilitate operations: Easily copy the displayed JSON for use in essential activities such as API calls.
• Download for reference: Download the JSON configuration as a file for backup or collaboration.

LucidAcademyLucidworks offers free training to help you get started.The Quick Learning for JSON Viewer focuses on how to incorporate the JSON viewer into your daily workflow:

Visit the LucidAcademy to see the full training catalog.

​

Asynchronous parsing service

​

Managed Fusion

​

Cloud signal storage for Managed Fusion

​

Improvements

• Introduced significant improvements to job status reporting within Fusion. A dedicated job function microservice, job-config, has been added to control job execution and store job history. This microservice requires no configuration from the client. In addition, to optimize communication efficiency, synchronous calls have been replaced with asynchronous communication through Kafka. As a result of these changes, job reports are now far more accurate and reliable than before.
  These changes do not impact Fusion API usage or user workflows.
• Introduced a configurable timeout for datasource jobs, in case the connection to the backend job is lost. Previously, the job was stopped after a fixed duration of 100 seconds.
• Previously query pipeline pods could restart due to scaling or other reasons, leading to 503 errors in the API gateway. This release introduces a configurable retry setting for the api-gateway service that will automatically attempt to reconnect to the query pipeline pods. This addresses the previously observed 503 errors under sustained query load.
• Pre-packaged configurations for commonly used dimensionalities (64, 384, 512, and 768) in vector search operations within Solr are added to Fusion. These configurations leverage a naming convention that incorporates dimensionality into dynamic field names, simplifying setup and management for users. For example:
  Copy

  <fieldType
      class="solr.DenseVectorField"
      codecFormat="Lucene90HnswVectorsFormat"
      hnswBeamWidth="40"
      hnswMaxConnections="10"
      name="knn_512_vector"
      similarityFunction="cosine"
      vectorDimension="512" />
  
  <dynamicField
      docValues="false"
      indexed="true"
      multiValued="false"
      name="*_512_v"
      required="false"
      stored="false"
      type="knn_512_vector" />
  

• Introduced automated management of Kafka topic partitions for indexing subscriptions within Fusion. Fusion now intelligently determines the optimal number of partitions, creates the topics with appropriate configurations, and initiates the subscription process.

​

Bug Fixes

• Fixed a bug that prevented remote connector datasources from indexing data after encountering a “No Plugin Activity” error. Previously, affected datasources required recreation with a different name despite maintaining identical specifications.
• Fixed a bug that caused a Solr syntax error when attempting to delete an aclDocument using the SDK method newDeleteGraphAccessControlItem if the ID of the document contained special characters.
• Fixed a bug that sometimes resulted in a ConcurrentModificationException error during high-load testing of query pipelines utilizing Solr Subquery and Merge Async Results stages.
• Addressed a race condition impacting dynamic pricing functionality. Previously, concurrent user requests for the same external file could lead to the second request encountering an error. The fix ensures proper handling of concurrent requests, eliminating the potential for this error.
• Fixed a bug that caused a ConcurrentModificationException error during the .RawPull replication process within Solr.
• Fixed a bug in the UI login process where attempting to log in with an incorrect password after an expired session resulted in no error message being displayed on the UI.

​

Deprecations

​

V1 Fusion connectors

• Some V1 connectors already have a direct replacement available. You can find the replacement connector on the Fusion Connectors Deprecations and Removals page.
• For all other V1 connectors, a replacement is still under development. We will update the documentation when the replacement is available.

​

Banana dashboards

​

Other deprecations

• App Insights and the insights microservice are deprecated and will be removed in a future release.
• The Parsers CRUD API from the indexing service is deprecated and will be removed in a future release. Use /async-parsing/ instead.
• The Train a Smart Answers cold start model job is deprecated and will be removed in a future release. Use one of the pre-trained models or the supervised training job instead.
• The Data Augmentation job is deprecated and will be removed in a future release.

​

Known issues

• New Kerberos security realms cannot be configured successfully in this version of Fusion.