LucidAcademyLucidworks offers free training to help you get started.The Course for Smart Answers focuses on how to utilize Smart Answers to go beyond classical token-based matching mechanisms by leveraging contextual information and query understanding:Visit the LucidAcademy to see the full training catalog.
Example business use cases
Call center or IT support
- Embed this system as a self-help feature on your Help page or Contact Us page to reduce the call center load.
- Make it available to your customer support team to find the answers to already-solved problems.
Zero-result search problem in E-commerce:
Queries that lead to zero-results is a huge problem for E-commerce that leads to income loss and decrease of the overall user experience. Semantic search does not have this problem as it does not operate on the exact token matches as classical search. Instead search is done in the vector space which can find relevant products even if there is no token overlapping.Questions about products for E-commerce:
E-commerce websites can use this system to search “how to” content, product user manuals, or existing product questions. For example, amazon.com provides a search function on questions about each product.Search in Slack, email conversations, or SharePoint FAQ docs
You can achieve fast knowledge extraction by applying this solution to these types of knowledge repositories.Improve search for long queries
As the solution utilizes state of the art Deep Learning techniques, it is able to capture semantic and contextual information into query understanding. This makes it very suitable to work with long queries or natural language questions.Get started with Smart Answers
To get started, you need a trained machine learning model. There are two methods for building a model, depending on the kind of data you already have. Each method requires a slightly different model training procedure, but the model deployment procedure is the same for both. To implement Smart Answers, follow this workflow:- Train or install a machine learning model. This process differs depending on whether you use the Smart Answers supervised solution or the Smart Answers cold start solution.
- Use the supervised solution when you already have a collection of query/response pairs or if you can construct such a dataset from the signals data. The input is a dataset of query/response pairs. See Train a Smart Answers Supervised Model.
Train a Smart Answers Supervised Model
Train a Smart Answers Supervised Model
The Supervised solution for Smart Answers begins with training a model using your existing data and the Smart Answers Supervised Training job, as explained in this topic. The job includes an auto-tune feature that you can use instead of manually tuning the configuration.See also Advanced Model Training Configuration for Smart Answers.
Training job requirements
Storage150GB plus 2.5 times the total input data size.Processor and memoryThe memory requirements depend on whether you choose GPU or CPU processing:GPU | CPU |
---|---|
|
|
If your training data contains more than 1 million entries, use GPU.
Prepare the input data
-
Format your input data as question/answer pairs, that is, a query and its corresponding response in each row.
You can do this in any format that Fusion supports.
If there are multiple possible answers for a unique question, then repeat the questions and put the pair into different rows to make sure each row has one question and one answer, as in the example JSON below:
-
Index the input data in Fusion.
If you wish to have the training data in Fusion, index it into a separate collection for training data such as
model_training_input
. Otherwise you can use it directly from the cloud storage.
Configure the training job
- In Fusion, navigate to Collections > Jobs.
-
Select Add > Smart Answers Supervised Training:
-
In the Training Collection field, specify the input data collection that you created when you prepared the input data.
You can also configure this job to read from or write to cloud storage.
- Enter the names of the Question Field and the Answer Field in the training collection.
- Enter a Model Deployment Name. The new machine learning model will be saved in the blob store with this name. You will reference it later when you configure your pipelines.
-
Configure the Model base.
There are several pre-trained word and BPE embeddings for different languages, as well as a few pre-trained BERT models.
If you want to train custom embeddings, select
word_custom
orbpe_custom
. This trains Word2vec on the provided data and specified fields. It might be useful in cases when your content includes unusual or domain-specific vocabulary. If you have content in addition to the query/response pairs that can be used to train the model, then specify it in the Texts Data Path. When you use the pre-trained embeddings, the log shows the percentage of processed vocabulary words. If this value is high, then try using custom embeddings. The job trains a few (configurable) RNN layers on top of word embeddings or fine-tunes a BERT model on the provided training data. The result model uses an attention mechanism to average word embeddings to obtain the final single dense vector for the content.Dimension size of vectors for Transformer-based models is 768. For RNN-based models it is 2 times the number units of the last layer. To find the dimension size: download the model, expand the zip, open the log and search forEncoder output dim size:
line. You might need this information when creating collections in Milvus. - Optional: Check Perform auto hyperparameter tuning to use auto-tune. Although training module tries to select the most optimal default parameters based on the training data statistics, auto-tune can extend it by automatically finding even better training configuration through hyper-parameter search. Although this is a resource-intensive operation, it can be useful to identify the best possible RNN-based configuration. Transformer-based models like BERT are not used during auto hyperparameter tuning as they usually perform better yet they are much more expensive on both training and inference time.
-
Click Save.
If using solr as the training data source ensure that the source collection contains the
random_*
dynamic field defined in itsmanaged-schema.xml
. This field is required for sampling the data. If it is not present, add the following entry to themanaged-schema.xml
alongside other dynamic fields<dynamicField name="random_*" type="random"/>
and <fieldType class=“solr.RandomSortField” indexed=“true” name=“random”/> alongside other field types. - Click Run > Start.
Next steps
- See A Smart Answers Supervised Job’s Status and Output
- Configure The Smart Answers Pipelines
- Evaluate a Smart Answers Query Pipeline
- Use the cold start solution when you have no historical training data or fewer than 200 query/response pairs. Each method requires a slightly different model training procedure, but the model deployment procedure is the same for both.
- If you have a pre-trained cold start model, see Set Up a Pre-Trained Cold Start Model for Smart Answers, which deploys the existing model into Fusion.
- If you have a body of content that can be used for unsupervised training, see Train a Smart Answers Cold Start Model.
Set Up a Pre-Trained Cold Start Model for Smart Answers
Set Up a Pre-Trained Cold Start Model for Smart Answers
Lucidworks provides these pre-trained cold start models for Smart Answers:
qna-coldstart-large
- this is a large model trained on variety of corpuses and tasks.qna-coldstart-multilingual
- covers 16 languages. List of supported languages: Arabic, Chinese-simplified, Chinese-traditional, English, French, German, Italian, Japanese, Korean, Dutch, Polish, Portuguese, Spanish, Thai, Turkish, Russian.
Dimension size of vectors for both models is 512. You might need this information when creating collections in Milvus.
Deploy a pre-trained cold-start model into Fusion
The pre-trained cold-start models are deployed using a Fusion job called Create Seldon Core Model Deployment. This job downloads the selected pre-trained model and installs it in Fusion.- Navigate to Collections > Jobs.
- Select Add > Create Seldon Core Model Deployment.
- Enter a Job ID, such as
deploy-qna-coldstart-multilingual
ordeploy-qna-coldstart-large
. - Enter the Model Name, one of the following:
qna-coldstart-multilingual
qna-coldstart-large
- In the Docker Repository field, enter
lucidworks
. - In the Image Name field, enter one of the following:
qna-coldstart-multilingual:v1.1
qna-coldstart-large:v1.1
- Leave the Kubernetes Secret Name for Model Repo field empty.
- In the Output Column Names for Model field, enter one of the following:
qna-coldstart-multilingual:[vector]
[vector, compressed_vector]
- Click Save.
- Click Run > Start to start the deployment job.
Next steps
- Configure The Smart Answers Pipelines
- Evaluate a Smart Answers Query Pipeline
Train a Smart Answers Cold Start Model
Train a Smart Answers Cold Start Model
The Smart Answers Cold Start Training job is deprecated in Fusion 5.12.
Smart Answers comes with two pre-trained cold-start models. If your data does not have many domain-specific words, then consider using a pre-trained model.
Configure the training job
- In Fusion, navigate to Collections > Jobs.
- Select Add > Smart Answer Coldstart Training.
-
In the Training Collection field, specify the collection that contains the content that can be used to answer questions.
You can also configure this job to read from or write to cloud storage.
- Enter the name of the Field which contains the content documents.
- Enter a Model Deployment Name. The new machine learning model will be saved in the blob store with this name. You will reference it later when you configure your pipelines.
-
Configure the Model base.
There are several pre-trained word and BPE embeddings for different languages, as well as a few pre-trained BERT models.
If you want to train custom embeddings, please select
word_custom
orbpe_custom
. This trains Word2vec on the data and fields specified in Training collection and Field which contains the content documents. It might be useful in cases when your content includes unusual or domain-specific vocabulary. When you use the pre-trained embeddings, the log shows the percentage of processed vocabulary words. If this value is high, then try using custom embeddings. During the training job analyzes the content data to select weights for each of the words. The result model performs the weighted average of word embeddings to obtain final single dense vector for the content. -
Click Save.
If using solr as the training data source ensure that the source collection contains the
random_*
dynamic field defined in itsmanaged-schema.xml
. This field is required for sampling the data. If it is not present, add the following entry to themanaged-schema.xml
alongside other dynamic fields<dynamicField name="random_*" type="random"/>
and<fieldType class="solr.RandomSortField" indexed="true" name="random"/>
alongside other field types. - Click Run > Start.
Next steps
- Configure The Smart Answers Pipelines
- Evaluate a Smart Answers Query Pipeline
- Configure the index and query pipelines.
Fusion includes default pipelines to get you started. See Configure the Smart Answers Pipelines.
Configure the Smart Answers Pipelines
Configure the Smart Answers Pipelines
Before beginning this procedure, train a machine learning model using either the FAQ method or the cold start method.Regardless of how you set up your model, the deployment procedure is the same:
Encode Answer (Encode Into Milvus) stage
In the Encode Question stage, specify 
In the Query Answers stage, we set the 
Now we can ensemble them together with the Milvus Ensemble Query Stage with the 

Only one custom index stage needs to be configured in your index pipeline, the Encode into Milvus index stage.The Encode into Milvus index stage uses the specified model to encode the
- Create the
Milvus
collection. - Configure the
smart-answers
index pipeline. - Configure the
smart-answers
query pipeline.
Create the Milvus collection
For complete details about job configuration options, see the Create Collections in Milvus job.- Navigate to Collections > Jobs > Add + and select Create Collections in Milvus.
-
Configure the job:
- Enter an ID for this job.
- Under Collections, click Add.
- Enter a collection name.
- In the Dimension field, enter the dimension size of vectors to store in this Milvus collection. The Dimension should match the size of the vectors returned by the encoding model. For example, the
Smart Answers Pre-trained Coldstart
models outputs vectors of 512 dimension size. Dimensionality of encoders trained bySmart Answers Supervised Training
job depends on the provided parameters and printed in the training job logs.
-
Click Save.
The
Create Collections in Milvus
job can be used to create multiple collections at once. In this image, the first collection is used in the indexing and query steps. The other two collections are used in the example. - Click Run > Start to run the job.
Configure the index pipeline
- Open the Index Workbench.
-
Load or create your datasource using the default smart-answers index pipeline.
-
Configure the
Encode into Milvus stage:
- change the value of Model ID to match the model deployment name you chose when you configured the model training job.
-
Change
Field to Encode
to the document field name to be processed and encoded into dense vectors. -
Ensure the
Encoder Output Vector
matches the output vector from the chosen model. -
Ensure the
Milvus Collection Name
matches the collection name created via theCreate Milvus Collection
job.To test out your settings, turn onFail on Error
in theEncode into Milvus
stage and Apply the changes. This will cause an error message to display if any settings need to be changed.
- Save the datasource.
- Index your data.
Configure the query pipeline
- Open the Query Workbench.
-
Load the default smart-answers query pipeline.
-
Configure the Milvus Query stage:
- Change the Model ID value to match the model deployment name you chose when you configured the model training job.
-
Ensure the
Encoder Output Vector
matches the output vector from the chosen model. -
Ensure the
Milvus Collection Name
matches the collection name created via theCreate Milvus Collection
job. -
Milvus Results Context Key
can be changed as needed. It will be used in the Milvus Ensemble Query Stage to calculate the query score.
-
In the Milvus Ensemble Query stage, update the
Ensemble math expression
as needed based on your model and the name used in the prior stage for the storing the Milvus results. In versions 5.4 and later, you can also set theThreshold
so that the Milvus Ensemble Query Stage will only return items with a score greater than or equal to the configured value. - Save the query pipeline.
Pipeline Setup Example
Index and retrieve the question and answer together
To show question and answer together in one document (that is, treat the question as the title and the answer as the description), you can index them together in the same document. You can still use the defaultsmart-answers
index and query pipelines with a few additional changes.Prior to configuring the Smart Answers pipelines, use the Create Milvus Collection
job to create two collections, question_collection
and answer_collection
, to store the encoded “questions” and the encoded “answers”, respectively.Index Pipeline
As shown in the pictures below, you will need two Encode into Milvus stages, named Encode Question and Encode Answer respectively.Encode Question (Encode Into Milvus) stage

Field to Encode
to be title_t
and change the Milvus Collection Name
to match the new Milvus collection, question_collection
.In the Encode Answer stage, specify Field to Encode
to be description_t
and change the Milvus Collection Name
to match the new Milvus collection, answer_collection
.Query Pipeline
Since we have two dense vectors generated during indexing, at query time we need to compute both query to question distance and query to answer distance. This can be set up as the pictures shown below with two Milvus Query Stages, one for each of the two Milvus collections. To store those two distances separately, theMilvus Results Context Key
needs to be different in each of these two stages.In the Query Questions stage, we set the Milvus Results Context Key
to milvus_questions
and the Milvus collection name to question_collection
.Query Questions (Milvus Query) stage:
Milvus Results Context Key
to milvus_answers
and the Milvus collection name to answer_collection
.Query Answers (Milvus Query) stage:
Ensemble math expression
combining the results from the two query stages. If we want the question scores and answer scores weighted equally, we would use: 0.5 * milvus_questions + 0.5 * milvus_answers
.
This is recommended especially when you have limited FAQ dataset and want to utilize both question and answer information.Milvus Ensemble Query stage
Evaluate the query pipeline
The Evaluate QnA Pipeline job evaluates the rankings of results from any Smart Answers pipeline and finds the best set of weights in the ensemble score.Detailed pipeline setup
Typically, you can use the default pipelines included with Fusion AI. These pipelines now utilize Milvus to store encoded vectors and to calculate vector similarity. This topic provides information you can use to customize the Smart Answers pipelines.”smart-answers” index pipeline | ![]() | Encode into Milvus stage |
”smart-answers” query pipeline | ![]() |
Create the Milvus collection
Prior to indexing data, the Create Collections in Milvus job can be used to create the Milvus collection(s) used by the Smart Answers pipelines (see Milvus overview).Job ID
. A unique identifier for the job.Collection Name
. A name for the Milvus collection you are creating. This name is used in both the Smart Answer Index and the Smart Answer Query pipelines.Dimension
. The dimension size of the vectors to store in this Milvus collection. The Dimension should match the size of the vectors returned by the encryption model. For example, if the model was created with either theSmart Answers Coldstart Training
job or theSmart Answers Supervised Training
job with the Model Baseword_en_300d_2M
, then the dimension would be 300.Index file size
. Files with more documents than this will cause Milvus to build an index on this collection.Metric
. The type of metric used to calculate vector similarity scores.Inner Product
is recommended. It produces values between 0 and 1, where a higher value means higher similarity.
Index pipeline setup
Stages in the default “smart-answers” index pipeline
The Encode into Milvus Index Stage
If you are using a dynamic schema, make sure this stage is added after the Solr Dynamic Field Name Mapping stage.
Field to Encode
and store it in Milvus in the given Milvus collection.
There are several required parameters:Model ID
. The ID of the model.Encoder Output Vector
. The name of the field that stores the compressed dense vectors output from the model. Default value:vector
.Field to Encode
. The text field to encode into a dense vector, such asanswer_t
orbody_t
.Milvus Collection Name
. The name of the collection you created via the Create Milvus Collection job, which will store the dense vectors. When creating the collection you specify the type of Metric to use to calculate vector similarity. This stage can be used multiple times to encode additional fields, each into a different Milvus collection.
Query pipeline setup
The Query Fields stage
The first stage is Query Fields. For more information see the Query Fields stage.The Milvus Query stage
The Milvus Query stage encodes the query into a vector using the specified model. It then performs a vector similarity search against the specified Milvus collection and returns a list of the best document matches.Model ID
. The ID of the model used when configuring the model training job.Encoder Output Vector
. The name of the output vector from the specified model, which will contain the query encoded as a vector. Defaults to vector.Milvus Collection Name
. The name of the collection that you used in theEncode into Milvus
index stage to store the encoded vectors.Milvus Results Context Key
. The name of the variable used to store the vector distances. It can be changed as needed. It will be used in the Milvus Ensemble Query Stage to calculate the query score for the document.Number of Results
. The number of highest scoring results returned from Milvus. This stage would typically be used the same number of times that theEncode into Milvus
index stage is used, each with a different Milvus collection and a differentMilvus Results Context Key
.
The Milvus Ensemble Query stage
The Milvus Ensemble Query takes the results of the Milvus Query stage(s) and calculates theensemble score
, which is used to return the best matches.Ensemble math expression
. The mathematical expression used to calculate theensemble score
. It should reference the value(s) variable name specified in theMilvus Results Context Key
parameter in the Milvus Query stage.Result field name
. The name of the field used to store theensemble score
. It defaults toensemble_score
.Threshold
- A parameter that filters the stage results to remove items that fall below the configured score. Items with a score at, or above, the threshold will be returned.
The Threshold feature is only available in Fusion 5.4 and later.
The Milvus Response Update Query stage
The Milvus Response Update Query stage does not need to be configured and can be skipped if desired. It inserts the Milvus values, including theensemble_score
, into each of the returned documents, which is particularly useful when there is more than one Milvus Query Stage
. This stage needs to come after the Solr Query
stage.Short answer extraction
By default, the question-answering query pipelines return complete documents that answer questions. Optionally, you can extract just a paragraph, a sentence, or a few words that answer the question.- Evaluate the query pipeline’s effectiveness.
Fine tune your query pipeline configuration by running a job that analyzes its effectiveness. See Evaluate a Smart Answers Query Pipeline.
Evaluate a Smart Answers Query Pipeline
Evaluate a Smart Answers Query Pipeline
The Smart Answers Evaluate Pipeline job evaluates the rankings of results from any Smart Answers pipeline and finds the best set of weights in the ensemble score. This topic explains how to set up the job.Before beginning this procedure, prepare a machine learning model using either the Supervised method or the Cold start method, or by selecting one of the pre-trained cold start models, then Configure your pipelines.The input for this job is a set of test queries and the text or ID of the correct responses. At least 100 entries are needed to obtain useful results. The job compares the test data with Fusion’s actual results and computes variety of the ranking metrics to provide insights of how well the pipeline works. It is also useful to use to compare with other setups or pipelines.
17. Click Run > Start.
Example: recall@1,3,5 for different weights and distances
In addition to metrics, a results evaluation file is indexed to the specified output evaluation collection. It provides the correct answer position for each test question as well as the top returned results for each field specified in Return fields parameter.
Prepare test data
-
Format your test data as query/response pairs, that is, a query and its corresponding answer in each row.
You can do this in any format that Fusion support, but parquet file would be preferable to reduce the amount of possible encoding issues.
The response value can be either the document ID of the correct answer in your Fusion index (preferable), or the text of the correct answer.
If there are multiple possible answers for a unique question, then repeat the questions and put the pair into different rows to make sure each row has exactly one query and one response.If you use answer text instead of an ID, make sure that the answer text in the evaluation file is formatted identically to the answer text in Fusion.
-
If you wish to index test data into Fusion, create a collection for your test data, such as
sa_test_input
and index the test data into that collection.
Configure the evaluation job
-
If you wish to save the job output in Fusion, create a collection for your evaluation data such as
sa_test_output
. - Navigate to Collections > Jobs.
- Select New > Smart Answers Evaluate Pipeline (Evaluate QnA Pipeline in Fusion 5.1 and 5.2).
-
Enter a Job ID, such as
sa-pipeline-evaluator
. -
Enter the name of your test data collection (such as
sa_test_input
) in the Input Evaluation Collection field. -
Enter the name of your output collection (such as
sa_test_output
) in the Output Evaluation Collection field.In Fusion 5.3 and later, you can also configure this job to read from or write to cloud storage. - Enter the name of the Test Question Field in the input collection.
- Enter the name of the answer field as the Ground Truth Field.
- Enter the App Name of the Fusion app where the main Smart Answers content is indexed.
- In the Main Collection field, enter the name of the Fusion collection that contains your Smart Answers content.
- In the Fusion Query Pipeline field, enter the name of the Smart Answers query pipeline you want to evaluate.
- In the Answer Or ID Field In Fusion field, enter the name of the field that Fusion will return containing the answer text or answer ID.
- Optionally, you can configure the Return Fields to pass from Smart Answers collection into the evaluation output.
Check the Query Workbench to see which fields are available to be returned.
- Configure the Metrics parameters:
- Solr Scale Function
Specify the function used in the Compute Mathematical Expression stage of the query pipeline, one of the following:max
log10
pow0.5
- List of Ranking Scores For Ensemble
To find the best weights for different ranking scores, list the names of the ranking score fields, separated by commas. Different ranking scores might include Solr score, query-to-question distance, or query-to-answer distance from the Compute Mathematical Expression pipeline stage. - Target Metric To Use For Weight Selection
The target ranking metric to optimize during weights selection. The default ismrr@3
.
- Optionally, read about the advanced parameters and consider whether to configure them as well.

Examine the output
The job provides a variety of metrics (controlled by the Metrics list advanced parameter) at different positions (controlled by the Metrics@k list advanced parameter) for the chosen final ranking score (specified in Ranking score parameter).Example: Pipeline evaluation metrics

- Check the job status and output. When your job has completed, you can check the job’s status through the ML Model service logs. See View a Smart Answers (QnA) Job’s Status and Output.
View a Smart Answers Job's Status and Output
View a Smart Answers Job's Status and Output
This topic explains how you can track the running steps of the following jobs:
- Smart Answers Supervised Training
- Smart Answers Coldstart Training
- Smart Answers Evaluate Pipeline
- Find the name of the ML Model service pod:
The pod name looks like
<namespace>-ml-model-service-ui-<hash>-<random>
, as inf5-ml-model-service-ui-547dd78d6-p9d6q
. - Set up port forwarding:
- In the Fusion UI, navigate to Collections > Jobs.
- Select your Smart Answers (QnA) model training job.
- Click Job History.
- Find the ML Model workflow ID.
- In the ML Model service UI, locate instances of the ID in the logs.
Smart Answers jobs
These jobs provide the machine learning features that drive Smart Answers:-
Machine learning model training:
- Smart Answers Supervised Training job. Fusion includes default pipelines to get you started. See Configure the Smart Answers Pipelines.
- Smart Answers Coldstart Training job.
- Machine learning model deployment:
-
Smart Answers Evaluate Pipeline
This job analyzes your configured Smart Answers query pipeline to provide insights about its effectiveness so that you can fine-tune your configuration for the best possible results.
Smart Answers pipelines and stages
Once you have trained and deployed your model, you can use one of the default pipelines that are automatically created with your Fusion app. Both pipelines are calledAPP_NAME-smart-answers
.
See Configure the Smart Answers Pipelines for more information.
Pipeline | Stages |
---|---|
”-smart-answers” index pipeline | ![]() |
”-smart-answers” query pipeline | ![]() |
Short answer extraction
By default, the question-answering query pipelines return complete documents that answer questions. Optionally, you can extract just a paragraph, a sentence, or a few words that answer the question. See Extract Short Answers from Longer Documents.Extract Short Answers from Longer Documents
Extract Short Answers from Longer Documents
This topic explains how to deploy and configure the transformer-based deep learning model for short answer extraction with Smart Answers. This model is useful for analyzing long documents and extracting just a paragraph, a sentence, or a few words that answer the question.
This model is trained on the SQuAD2.0 dataset which consists of questions about Wikipedia articles and answers gleaned from those articles. Therefore, this model is most effective with Wikipedia-like content and may produce uneven results when applied to more informal content such as message boards.
The out-of-the-box (OOTB) model only supports English content.
Hardware recommendations
When creating a nodePool to perform short answer extraction, use a configuration that meets these guidelines in order to achieve the best performance:- It is strongly recommended to use the latest possible Intel CPU architecture; Intel CascadeLake or higher architectures are recommended.
- Large core count is also recommended: 12-16 cores with 32G of RAM.
Deploy the model in Fusion
- Navigate to Collections > Jobs.
- Select New > Create Seldon Core Model Deployment.
-
Configure the job as follows:
- Job ID. the ID for this job, such as
deploy-answer-extractor
. - Model Name. model name of the Seldon Core deployment that will be referenced in the Machine Learning pipeline stage configurations, such as
answer-extractor
. - Docker Repository.
lucidworks
- Image Name.
answer-extractor:v1.1
- Kubernetes Secret Name for Model Repo. (empty)
- Output Column Names for Model.
[answer,score,start,end]
- Job ID. the ID for this job, such as
- Click Save.
- Click Run > Start.
Configure the Machine Learning query stage
This model provides the best results when used with one of the question-answering query pipelines. The default query pipeline is calledAPP_NAME-smart-answers
.Starting with one of those pipelines, add a new Machine Learning stage to the end of the pipeline and configure it as described below.How to configure short answer extraction in the query pipeline- Make sure you have performed the basic configuration of your query pipeline.
- In the query pipeline, click Add a Stage > Machine Learning.
- In the Model ID field, enter the model name you configured above, such as answer-extractor.
-
In the Model input transformation script field, enter the following:
Configure the parameters in the script as follows:
-
question
(Required). The name of the field containing the questions.Make sure that the question is provided as it was originally entered by user. If you have previous stages that augments question (like stopwords removing or synonyms expansion), it is better to copy original question and use it for the answer extraction without additional modifications. -
context
(Required). A string or list of contexts; by default this is the firstnum_docs_to_extract
documents in the output of the previous stage in the pipeline. If only one question is present with multiple contexts, that question will be applied to every context and vice versa for 1 context and multiple questions. If a list of questions and contexts is passed, a 1:1 mapping of questions and contexts will be created in the order in which they’re passed. -
topk
. The number of answers to return (will be chosen by order of likelihood). Default: 1 -
handle_impossible_answer
. Whether or not to deal with a question that has no answer in the context. If true, an empty string is returned. If false, the most probable (topk
) answer(s) are returned regardless of how low the probability score is. Default: TrueExperiment with this parameter to see what value returns the most acceptable answers.
batch_size
. How many samples to process at a time. Reducing this number will reduce memory usage but increase execution time, while increasing it will increase memory usage and decrease execution time to a certain extent. Default: 8max_context_len
. If set to greater than 0, truncate contexts to this length in characters. Default: 5000max_answer_len
. The maximum length of predicted answers (for example, only answers with a shorter length are considered). Default: 15max_question_len
. The maximum length of the question after tokenization. It will be truncated if needed. Default: 64doc_stride
. If the context is too long to fit with the question for the model, it will be split in several chunks with some overlap. This argument controls the size of that overlap. Default: 128max_seq_len
. The maximum length of the total sentence (context + question) after tokenization. The context will be split in several chunks (using doc_stride) if needed. Default: 384
-
-
In the Model output transformation script field, enter the following:
- Save the pipeline.
Model output
The model adds the following fields to the query pipeline output:answer
. The short answer extracted from the context. This may be blank ifhandle_impossible_answers=True
andtopk=1
.score
. The score for the extracted answers.start
. The start index of the extracted answer in the provided context.end
. The end index of the extracted answer in the provided context.
Recreate a Milvus collection
If a Milvus collection is lost, you can recreate the collection. You can also use these steps to create a Milvus collection for a different field or a Milvus collection that uses a different encryption model. These steps assume that:- You used the Smart Answers pipeline to index data, which created the Milvus and Solr collections.
- The created Solr collection still exists, which is used as the Source Collection.
Recreate a Milvus collection
Recreate a Milvus collection
-
Create the Milvus collection. See Create Collections in Milvus for more information.
If the Milvus collection still exists and you want to overwrite it, select the Override Collections checkbox. This option deletes the current collection, allowing you to create a new collection.
-
Edit the Smart Answers Index Pipeline as follows:
- Disable the Solr Indexer stage.
-
If you are creating a Milvus collection for a different field, or one that uses a different encryption model, access the Encode into Milvus stage and:
- Specify the model, the Encoder Output Vector, and the Field to Encode.
- Verify the Milvus Collection Name refers to the new Milvus collection.
- Navigate to the Datasources panel.
-
Select Add a Solr connector and enter the following information:
- Pipeline ID. Smart Answers pipeline
- Solr Connection Type. SolrCloud
-
SolrCloud Zookeeper Host String. Execute the following curl command. The response displays the SolrCloud Zookeeper Host String value. In the following
RESPONSE
example, the value you would set for the SolrCloud Zookeeper Host String isns-zookeeper-0.ns-zookeeper-headless:2181
.RESPONSE - Source Collection. Original collection from the initial Smart Answers pipeline indexing job
- Navigate to Index Workbench and load the new solr-index datasource.
- Select Start Job to run the Solr datasource through the updated Smart Answers pipeline.
- When the data is reindexed, edit the Smart Answers pipeline and re-enable the Solr Indexer stage.