Forked Apache Tika Parser Stage
A simplified Apache Tika parser more geared towards an Enterprise Search crawl where all documents are parsed in a forked Java Virtual Machine. If memory issues occur during the parse, such as an Out Of Memory condition, the connector job will be unaffected.
|
|
The Forked Apache Tika parser is only available on Fusion 4.2.4+. To use this parser, you will be required to update to the latest version of Fusion.
|
|
|
When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.
|
A simplified Apache Tika parser more geared towards an Enterprise Search crawl where all documents are parsed in a forked Java Virtual Machine. If memory issues occur during the parse, such as an Out Of Memory condition, the connector job will be unaffected.
id - string
Default: 91fcd905-2320-435f-9b3b-c9f7e1aae937
label - string
A label for this Parser Stage
<= 255 characters
enabled - boolean
Default: true
mediaTypes - array[string]
Documents with a media type on this list will be matched by this parser stage. See inheritMediaTypes / use default media types for more.
inheritMediaTypes - boolean
Each parser stage has a built-in list of media types it handles by default. If this setting is true, that list will be used along with any optional additional types provided in the mediaTypes list. If this setting is false, this stage will only be selected for media types in the mediaTypes list, and the mediaTypes list becomes a mandatory property which must have at least one valid media type.
Default: true
pathPatterns - array[object]
Specify a file name or pattern that must be matched for this parser stage to run. Forward slashes ("/") are used to join names of files inside archives with the archive name.
object attributes:{syntax : {
display name: Pattern type
type: string
}pattern : {
display name: File name or pattern
type: string
}}
errorHandling - string
Default: mark
Allowed values: ignorelogfailmark
outputFieldPrefix - string
Fields extracted by this parser will be prefixed with this string. The remainder of the field name will be as detected in the stream
<= 20 characters
Match pattern: ^$|^[A-Za-z_][A-Za-z0-9_\-\.]+$
includeImages - boolean
Default: false
addFailedDocs - boolean
Default: false
contentEncoding - string
Default: binary
Allowed values: binarybase64
extractHtmlLinks - boolean
Collect links explicitly declared in document structure (e.g. using HTML tags, bookmarks, etc)
Default: true
maxBytesReturned - integer
Sets the maximum amount of bytes that can be returned from the parser.
Default: 100000000
parseTimeoutMs - integer
The maximum amount of time in milliseconds that a single parse can take.
Default: 60000
excludeContentTypes - array[string]
List of content types to exclude from parsing
zipBombCompressionRatio - integer
Maximum number of output bytes fusion will generate per input byte. If you are indexing highly compressed files, you may increase this value to avoid triggering 'Zip Bomb' detection
Default: 200
zipBombMaxDepth - integer
Returns the maximum XML element nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection
Default: 200
zipBombMaxPackageEntryDepth - integer
Sets the maximum package entry nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection
Default: 20
type - stringrequired
Default: tikafork
Allowed values: tikafork