Synonym Detection
The Synonym Detection feature generates pairs of synonyms and pairs of similar queries. Two words are considered potential synonyms when they are used in a similar context in similar queries. When synonym detection is enabled, a query that contains a matching term is expanded to include all of its synonyms, with the original term boosted by a factor of two.
Synonyms are applied in the Text Tagger stage of the query pipeline.
The Synonym and Similar Queries Detection job automatically creates synonym pairs based on your AI-generated data.
When you navigate to Relevance > Rules, the application displays the Query Rewriting screen. Select Synonym Detection. The application displays the Synonym Detection screen.
When you manually add new synonym pairs, subsequent job runs use those documents as input for machine learning to improve the job’s output. Unlike job-generated documents, manually-added query rewriting documents are never overwritten by new job output.
icon next to the synonym pair, then click the directionality icon:
Use Synonym Detection
Use Synonym Detection
LucidAcademyLucidworks offers free training to help you get started.The Course for Query Analytics focuses on how Fusion provides query analytics to detect and improve underperforming queries:
Reviewing auto-generated synonym pairs
Synonyms that are automatically generated by the Synonym and Similar Queries Detection job are assigned the following status value:-
Pending
The confidence level is ambiguous, and the result must be reviewed by a user before it can be deployed. It will only be moved from the
_query_rewrite_stagingcollection to the_query_rewritecollection when its status has changed to “Approved” and it has been published.By default, all results from a synonym job are set to “Pending”, since there are usually a limited number of synonyms, and synonym expansion can have high impact on relevancy.
How to review a pending synonym pair result
- Navigate to Relevance > Rules. The application displays the Query Rewriting screen.
-
Select Synonym Detection. The application displays the Synonym Detection screen.
Notice the Status facet on the left. Click Pending to view only the items that need review.
-
Click the icon next to the synonym pair.
-
In the Status column, select either “Approved” or “Denied”.
Optionally, you can also edit the synonym pair itself.
Where alternative synonyms were detected, you can click Suggestions to view and select them as replacements for the displayed synonym pair:
Although the Confidence field is also editable, changing its value makes no difference. -
Click the Close icon next to the updated synonym pair:
Approving a synonym pair does not automatically deploy it to the
_query_rewrite collection. When you have finished your review, you must click Publish to deploy your changes.Adding new synonym pairs
You can manually add synonym pairs in addition to any generated by the Synonym and Similar Queries Detection job.How to add a synonym pair
- Navigate to Relevance > Rules. The application displays the Query Rewriting screen.
- Select Synonym Detection. The application displays the Synonym Detection screen.
-
At the bottom of the rules list, click the
icon.
A new synonym pair appears at the top of the list:
- Enter the query term.
-
Enter one or more synonym pairs.
It is not necessary to set a confidence value.
- Select the synonym pair’s status, depending on whether you want to deploy it the next time you publish your changes (“Approved”) or save it for further review (“Pending”).
-
Click the check mark to save the new synonym pair:
Publishing your changes
How to publish updated synonym pairs
- In the Synonym Detection screen, click the PUBLISH button. Fusion prompts you to confirm that you want to publish your changes.
- Click PUBLISH.
You can un-publish a query rewrite by changing its status to “denied”, then clicking PUBLISH.
Synonym directionality
When you edit or create a synonym pair, you can configure its directionality, either uni-directional or bi-directional. To toggle between uni-directional and bi-directional, click the icon next to the synonym pair, then click the directionality icon:
Uni-directional synonyms
Uni-directional synonyms produce query substitutions. That is, when a query term matches a known uni-directional synonym, the original query term is replaced with the synonym. In the uni-directional example below, “iphone” is a synonym of “phone” but “phone” is not a synonym of “iphone”. When “phone” is found in a query, it is replaced with “iphone”.When you manually create a new synonym pair, the default is uni-directional.
Bi-directional synonyms
Bi-directional synonyms produce expanded queries. That is, when a query contains a known bi-directional synonym, the query is rewritten to include the original term plus all of its known bi-directional synonyms, resulting in a greater number of potentially relevant results. The original term is also boosted to help preserve the user’s intent. In the bi-directional example below, “tv” is a synonym of “television” and “television” is a synonym of “tv”. If a query contains either “tv” or “television”, the query is expanded to include both terms.Job-generated synonyms are always bi-directional unless a reviewer edits them.