Underperforming Queries

The Underperforming Query Rewriting feature uses your signals data to identify underperforming queries and suggest improved queries that could produce better conversion rates. When underperforming query rewriting is enabled and an incoming query contains a matching underperforming query term, the original term is replaced by the improved term.

Query improvements are applied in the Text Tagger stage of the query pipeline.

The Head/Tail Analysis job automatically creates query improvements based on your AI-generated data. When you navigate to Relevance > Query Rewriting > Underperforming Query Rewriting, you can review or edit the output from the job and manually add new query improvements. Your changes remain in the _query_rewrite_staging collection until you publish them.

When you manually add new query improvements, subsequent job runs use those documents as input for machine learning to improve the job’s output. Unlike job-generated documents, manually-added query rewriting documents are never overwritten by new job output.
Job-generated query improvements are always assigned an initial status of "Pending", never "Auto". Query improvements must be explicitly approved and published in order to be copied to the _query_rewrite collection.

Underperforming Queries screen

Reviewing auto-generated query improvements

Query improvements that are automatically generated by the Head/Tail Analysis job are assigned one of these Status values:

  • Auto

    These results have a sufficiently high confidence level to automatically deploy them to the _query_rewrite collection.

    No action is required on these results, though you can edit them if you wish.

  • Pending

    The confidence level is ambiguous, and the result must be reviewed by a user before it can be deployed. It will only be moved from the query_rewrite_staging collection to the _query_rewrite collection when its status has changed to "Approved" _and it has been published.

    See below for instructions.

How to review a pending query improvement result
  1. Navigate to Relevance > Query Rewriting > Underperforming Query Rewriting.

    Notice the Status facet on the left. Click Pending to view only the items that need review.
  1. Click the Edit icon icon next to the query improvement.

  2. In the Status column, select either "Approved" or "Denied".

    Optionally, you can also edit the query improvement itself.

    Although the Confidence field is also editable, changing its value makes no difference.
  3. Click the Close icon next to the updated query improvement:

    Close a query improvement

Approving a query improvement does not automatically deploy it to the _query_rewrite collection. When you have finished your review, you must click Publish to deploy your changes.

Adding new query improvements

In addition to the query improvements generated by the Head/Tail Analysis job, you can manually add your own.

How to add a query improvement
  1. Navigate to Relevance > Query Rewriting > Underperforming Query Rewriting.

  2. At the bottom of the rules list, click the Add icon icon.

    A new query improvement appears at the top of the list:

    Add a query improvement

  3. Enter the underperforming query.

  4. Enter one or more query improvements.

    It’s not necessary to set a confidence value.
  5. Select the query improvement’s status, depending on whether you want to deploy it the next time you publish your changes ("Approved") or save it for further review ("Pending").

  6. Click the check mark to save the new query improvement:

    Save a query improvement

Publishing your changes

How to publish updated query improvements
  1. In the Underperforming Query Rewriting screen, click the PUBLISH button.

    Fusion prompts you to confirm that you want to publish your changes.

  2. Click PUBLISH.

You can un-publish a query rewrite by changing its status to "pending" or "denied", then clicking PUBLISH.