> ## Documentation Index
> Fetch the complete documentation index at: https://doc.lucidworks.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Index Pipeline Stages

export const LwTemplate = ({title = "Key questions to get you started", icon = "sparkles", cta = "Powered by Agent Studio", linkHref = "https://lucidworks.com/demo/?utm_source=docs&utm_medium=referral&utm_campaign=docs_cta_ai"}) => {
  const [isLoaded, setIsLoaded] = useState(false);
  useEffect(() => {
    const timer = setTimeout(() => {
      setIsLoaded(true);
    }, 500);
    return () => clearTimeout(timer);
  }, []);
  return <div className="lw-template-container">
      <Card title={title} icon={icon}>
        {isLoaded && <span dangerouslySetInnerHTML={{
    __html: `<lw-template id="a029c1a9-28be-427e-b0e1-5d918920246a"></lw-template
            >`
  }} />}
        <Link href={linkHref} className="agent-studio-link text-left text-gray-600 gap-2 dark:text-gray-400 text-sm font-medium flex flex-row items-center hover:text-primary dark:hover:text-primary-light group-hover:text-primary group-hover:dark:text-primary-light">Powered by Lucidworks Agent Studio</Link>
      </Card>
    </div>;
};

[localhost link]: http://localhost:3000/docs/4/fusion-server/concepts/indexing/datasources/index-pipeline-stages

[mintlify link]: https://doc.lucidworks.com/docs/4/fusion-server/concepts/indexing/datasources/index-pipeline-stages

[old doc.lw link]: https://doc.lucidworks.com/fusion-server/4.2/161

An Index Pipeline takes content and transforms it into a document suitable for indexing by Solr via a series of modular operations called stages.
The objects sent from stage to stage are PipelineDocument objects.
Fusion provides many specialized index stages as well as a [JavaScript Index stage](/docs/4/fusion-server/reference/pipeline-stages/indexing/javascript-index-stage) that allows for custom processing via a JavaScript program. The general outline of theExtract/Transform/Load processing performed by an index pipeline is:

* Raw content is parsed into one or more PipelineDocument objects.
* Any number of intermediate stages operate on the document fields directly, or, in the case of specialized NLP tools, add annotations to a document.
* Finally, the PipelineDocument is sent to Solr for indexing.

A pipeline stage definition associates a unique ID with a set of properties.
Pipeline definitions are stored in ZooKeeper for reuse across pipelines and search applications.
The Fusion UI provides stage-specific panels used to define and configure each pipeline stage.
Alternatively, JSON can be used to specify the sequence of pipeline stages and registered via the Fusion REST API.
Some stages require additional resources, e.g., text files that contain lists of names, synonyms, places, or binary files which NLP language models.
These resources can be uploaded via the Fusion UI or the REST API.

<LwTemplate />

## Learn more

Available index pipeline stages are listed below:

## Document transformation

* [XML Transformation](/docs/4/fusion-server/reference/pipeline-stages/indexing/xml-transform-index-stage)

## Document filtering and enrichment

* [Detect Language](/docs/4/fusion-server/reference/pipeline-stages/indexing/language-detection-index-stage)
* [Exclude Documents](/docs/4/fusion-server/reference/pipeline-stages/indexing/exclude-documents-index-stage)
* [Format Signals](/docs/4/fusion-server/reference/pipeline-stages/indexing/signal-formatter-index-stage)
* [Include Documents](/docs/4/fusion-server/reference/pipeline-stages/indexing/include-documents-index-stage)
* [JDBC Lookup](/docs/4/fusion-server/reference/pipeline-stages/indexing/jdbc-index-stage)
* [REST Query](/docs/4/fusion-server/reference/pipeline-stages/indexing/indexing-rpc-stage)

## Field transformation

* [Date Parsing](/docs/4/fusion-server/reference/pipeline-stages/indexing/date-parsing-index-stage)
* [Field Mapping](/docs/4/fusion-server/reference/pipeline-stages/indexing/field-mapper-index-stage)
* [Filter Short Fields](/docs/4/fusion-server/reference/pipeline-stages/indexing/short-field-filter-index-stage)
* [Find and Replace](/docs/4/fusion-server/reference/pipeline-stages/indexing/find-replace-index-stage)
* [GeoIP Lookup](/docs/4/fusion-server/reference/pipeline-stages/indexing/geoip-lookup-index-stage)
* [Regex Field Extraction](/docs/4/fusion-server/reference/pipeline-stages/indexing/regular-expression-extractor-index-stage)
* [Regex Field Filter](/docs/4/fusion-server/reference/pipeline-stages/indexing/regular-expression-filter-index-stage)
* [Regex Field Replacement](/docs/4/fusion-server/reference/pipeline-stages/indexing/regular-expression-replacement-index-stage)
* [Resolve Multivalued Fields](/docs/4/fusion-server/reference/pipeline-stages/indexing/multi-value-resolver-index-stage)
* [Solr Dynamic Field Name Mapping](/docs/4/fusion-server/reference/pipeline-stages/indexing/solr-dynamic-field-name-mapping-index-stage)

## Natural language processing

* [Detect Sentences](/docs/4/fusion-server/reference/pipeline-stages/indexing/sentence-detection-index-stage)
* [Gazetteer Lookup Extraction](/docs/4/fusion-server/reference/pipeline-stages/indexing/gazetteer-lookup-extractor-index-stage)
* [OpenNLP NER Extraction](/docs/4/fusion-server/reference/pipeline-stages/indexing/opennlp-ner-extractor-index-stage)
* [Tag Part-of-Speech](/docs/4/fusion-server/reference/pipeline-stages/indexing/part-of-speech-index-stage)

## Indexing

* [Solr Indexer](/docs/4/fusion-server/reference/pipeline-stages/indexing/solr-indexer-stage)
* [Solr Partial Update Indexer](/docs/4/fusion-server/reference/pipeline-stages/indexing/solr-partial-update-indexer-stage)
* [Update Related Document](/docs/4/fusion-server/reference/pipeline-stages/indexing/update-related-document-index-stage)

## Troubleshooting

* [Logging](/docs/4/fusion-server/reference/pipeline-stages/indexing/logging-index-stage)
* [Send PagerDuty Message](/docs/4/fusion-server/reference/pipeline-stages/indexing/pagerduty-index-stage)
* [Send SMTP Email](/docs/4/fusion-server/reference/pipeline-stages/indexing/email-index-stage)
* [Send Slack Message](/docs/4/fusion-server/reference/pipeline-stages/indexing/slack-index-stage)
* [Write Log Message](/docs/4/fusion-server/reference/pipeline-stages/indexing/logging-message-index-stage)

## Advanced

* [Call Pipeline](/docs/4/fusion-server/reference/pipeline-stages/indexing/call-pipeline-index-stage)
* [Exclusion Filter](/docs/4/fusion-server/reference/pipeline-stages/indexing/exclusion-filter-index-stage)
* [Javascript](/docs/4/fusion-server/reference/pipeline-stages/indexing/javascript-index-stage)
* [Machine Learning](/docs/4/fusion-server/reference/pipeline-stages/indexing/machine-learning-index-stage)
* [Managed Javascript](/docs/4/fusion-server/reference/pipeline-stages/indexing/managed-javascript-index-stage)
* [Set Property](/docs/4/fusion-server/reference/pipeline-stages/indexing/set-property-index-stage)