Skip to main content
This feature is only available in Fusion 5.9.x for versions 5.9.15 and later.
The LWAI Batch Vectorize Index Stage is an integration between Fusion and Lucidworks AI to enrich your index with Generative AI predictions. This stage processes your documents in batches before sending them to the next stage in your index pipeline. Use this stage instead of the LWAI Vectorize Field index stage if you have many documents to process. All the field names and values for the LWAI Vectorize Field index stage are maintained in the LWAI Batch Vectorize index stage, so you can switch from the LWAI Vectorize Field stage while maintaining your existing index pipeline. To use this stage, non-admin Fusion users must be granted the PUT,POST,GET:/LWAI-ACCOUNT-NAME/** permission in Fusion, which is the Lucidworks AI API Account Name defined in Lucidworks AI Gateway when this stage is configured.

​
Configurable batch length and waiting time

In order to use the LWAI Batch Vectorize index stage, you must configure two fields in addition to the fields that are also included in the LWAI Vectorize Field stage. The Maximum Batch Size field allows you to configure how many documents to include in each batch when batch processing documents. The value should not exceed the maximum value supported by your model. The Lucidworks AI maximum value is 32. The Maximum Batch Delay field allows you to configure the maximum time to wait before sending a batch of documents to be vectorized. If the batch is not full within this time, the current batch will be sent regardless of size. This setting helps to balance latency and throughput while batch processing documents. The default value is 1000 milliseconds, or 1 second.

​
Configuration

When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.
⌘I