Apache Tika Parser Index Stage

Compatibilty Issues
Configuration

The Apache Tika Parser index stage type includes rules for parsing documents with Apache Tika. Fusion uses Tika v1.13. (Note that components of the Solr distribution included with Fusion contian their own Tika jar files; these are not used by Fusion.)

Compatibilty Issues

Raw streams create new docs which Tika then tries to parse again. For this reason, avoid using the SDK connector or any other client that streams to the index pipeline.

Configuration

Tip	When entering configuration values in the UI, use unescaped characters, such as `\t` for the tab character. When entering configuration values in the API, use escaped characters, such as `\\t` for the tab character.

When using Fusion's REST API, the type for this stage is: tika-parser.

Property Description, Type

addFailedDocs

Add Failed Documents

type: boolean

default value: 'false'

addOriginalContent

Add Original Document Content (Raw Bytes)

type: boolean

default value: 'true'

contentEncoding

Content Transport Encoding of the Content (per RFC1341)

type: string

default value: 'binary'

enum: { binary base64 }

contentField

Field Name Where Content is Expected

type: string

default value: '_raw_content_'

excludeContentTypes

Content Types to Exclude

List of content types to exclude from parsing

type: array of string

extractHtmlLinks

Extract XHTML Links

Collect links explicitly declared in document structure (e.g. using HTML tags, bookmarks, etc)

type: boolean

default value: 'true'

extractOtherLinks

Extract Other Links

Use regex-based heuristic extractor to collect likely links from plain text content in all fields.

type: boolean

default value: 'false'

flattenCompound

Flatten Compound Documents

type: boolean

default value: 'false'

includeContentTypes

Content Types to Include

List of content types to parse

type: array of string

includeImages

Include Images

type: boolean

default value: 'false'

keepOriginalStructure

Return Original XML and HTML Instead of Tika XML Output

type: boolean

default value: 'false'

returnXml

Return Parsed Content as XML or HTML

type: boolean

default value: 'false'

zipBombCompressionRatio

Maximum input-to-output byte ratio

Maximum number of output bytes fusion will generate per input byte. If you are indexing highly compressed files, you may increase this value to avoid triggering 'Zip Bomb' detection

type: integer

default value: '200'

zipBombMaxDepth

Maximum nesting depth

Returns the maximum XML element nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection

type: integer

default value: '200'

zipBombMaxPackageEntryDepth

Maximum package entry depth

Sets the maximum package entry nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection

type: integer

default value: '20'