Set Up Search-Rate Autoscaling

Search-rate autoscaling scales the number of Solr nodes in a Managed Search cluster up and down based on comparisons of the actual average of search rates for all nodes and a target average search rate for all nodes:

  • Up – When search load increases, Managed Search increases the number of Solr nodes to better meet the demand.

    When the average of the trailing one-minute search rates across current Solr nodes equals or exceeds the target search rate, Managed Search increases the number of nodes by one, until the maximum number of nodes maxNodes is reached.

  • Down – When search load decreases, Managed Search decreases the number of Solr nodes to reduce resource consumption.

    When the average of the trailing one-minute search rates across current Solr nodes is less than the target search rate, Managed Search decreases the number of nodes by one, until the minimum number of nodes minNodes is reached.

This diagram illustrates search-rate autoscaling. "QPN" is queries per node per time interval, that is, the average search rate across nodes.

Search-rate autoscaling

Search-rate autoscaling keeps the actual average search rate closer to the target average search rate

Attributes for search-rate autoscaling

Specify these attributes when enabling search-rate autoscaling.

Attribute Description

enabled

Specify true to enable autoscaling.

minNodes

The minimum number of Solr nodes to use. The smallest permitted minNodes is 3.

maxNodes

The maximum number of Solr nodes to use.

targetSearchRate

Target average of per-node search rates. This rate is used as a criterion for autoscaling both upward and downward. Looked at another way, Managed Search keeps the actual average search rate in the vicinity of targetSearchRate by adding Solr nodes to and subtracting Solr nodes from a Managed Search cluster.

Example JSON request body

Use this JSON request body in a PUT or PATCH request to the /customers/customerId/clusters/clusterId endpoint. The request enables search-rate autoscaling. When the trailing one-minute search rate averaged across current Solr nodes equals or exceeds 10000, then Managed Search increases the number of Solr nodes from 3 to 10. When the trailing one-minute search rate averaged across current Solr nodes falls below 10000, then Managed Search decreases the number of Solr nodes from 10 to 3.

{
  "id": "test-cluster",
  "nodeCount": 3,
  "nodeType": "standard-4",
  "storageSizeGB": 10,
  "description": "test cluster",
  "maintenanceTimeFrame": "SUN 21:45",
  "autoscaling": {
      "enabled":true,
      "minNodes":3,
      "maxNodes":10,
      "targetSearchRate":10000
  }
}