Fusion 5.12.0

Introduced significant improvements to job status reporting within Fusion. A dedicated job function microservice, job-config, has been added to control job execution and store job history. This microservice requires no configuration from the client. In addition, to optimize communication efficiency, synchronous calls have been replaced with asynchronous communication through Kafka. As a result of these changes, job reports are now far more accurate and reliable than before.

Introduced a configurable timeout for datasource jobs, in case the connection to the backend job is lost. Previously, the job was stopped after a fixed duration of 100 seconds.

Previously query pipeline pods could restart due to scaling or other reasons, leading to 503 errors in the API gateway. This release introduces a configurable retry setting for the api-gateway service that will automatically attempt to reconnect to the query pipeline pods. This addresses the previously observed 503 errors under sustained query load.

Pre-packaged configurations for commonly used dimensionalities (64, 384, 512, and 768) in vector search operations within Solr are added to Fusion. These configurations leverage a naming convention that incorporates dimensionality into dynamic field names, simplifying setup and management for users. For example:

<fieldType
    class="solr.DenseVectorField"
    codecFormat="Lucene90HnswVectorsFormat"
    hnswBeamWidth="40"
    hnswMaxConnections="10"
    name="knn_512_vector"
    similarityFunction="cosine"
    vectorDimension="512" />

<dynamicField
    docValues="false"
    indexed="true"
    multiValued="false"
    name="*_512_v"
    required="false"
    stored="false"
    type="knn_512_vector" />

Introduced automated management of Kafka topic partitions for indexing subscriptions within Fusion. Fusion now intelligently determines the optimal number of partitions, creates the topics with appropriate configurations, and initiates the subscription process.

Fixed a bug that prevented remote connector datasources from indexing data after encountering a "No Plugin Activity" error. Previously, affected datasources required recreation with a different name despite maintaining identical specifications.

Fixed a bug that caused a Solr syntax error when attempting to delete an aclDocument using the SDK method newDeleteGraphAccessControlItem if the ID of the document contained special characters.

Fixed a bug that sometimes resulted in a ConcurrentModificationException error during high-load testing of query pipelines utilizing Solr Subquery and Merge Async Results stages.

Addressed a race condition impacting dynamic pricing functionality. Previously, concurrent user requests for the same external file could lead to the second request encountering an error. The fix ensures proper handling of concurrent requests, eliminating the potential for this error.

Fixed a bug that caused a ConcurrentModificationException error during the .RawPull replication process within Solr.

Fixed a bug in the UI login process where attempting to log in with an incorrect password after an expired session resulted in no error message being displayed on the UI.