Apache Tika Server Stage
|
This stage is deprecated.
|
Apache Tika Server is a versatile parser that supports parsing many document formats.
This stage is not compatible with asynchronous Tika parsing.
|
When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.
|
A simplified Apache Tika parser more geared towards an Enterprise Search crawl where all documents are parsed by sending them to a Tika Server. Files will be sent to the tika-server service for parsing, which greatly lessens the amount of memory needed on Connector pods. This stage is deprecated. Use 'Apache Tika Container Parser' instead. This stage doesn't work with async-parsing.
id - string
Default: fadea556-ed79-47ae-9343-cdf9676dbd3c
label - string
A label for this Parser Stage
<= 255 characters
enabled - boolean
Default: true
mediaTypes - array[string]
Documents with a media type on this list will be matched by this parser stage. See inheritMediaTypes / use default media types for more.
inheritMediaTypes - boolean
Each parser stage has a built-in list of media types it handles by default. If this setting is true, that list will be used along with any optional additional types provided in the mediaTypes list. If this setting is false, this stage will only be selected for media types in the mediaTypes list, and the mediaTypes list becomes a mandatory property which must have at least one valid media type.
Default: true
ignoredMediaTypes - array[string]
Documents with a media type on this list will be not be processed by this parser stage.
pathPatterns - array[object]
Specify a file name or pattern that must be matched for this parser stage to run. Forward slashes ("/") are used to join names of files inside archives with the archive name.
object attributes:{syntax
: {
display name: Pattern type
type: string
}pattern
: {
display name: File name or pattern
type: string
}}
errorHandling - string
Default: mark
Allowed values: ignorelogfailmark
outputFieldPrefix - string
Fields extracted by this parser will be prefixed with this string. The remainder of the field name will be as detected in the stream
<= 20 characters
Match pattern: ^$|^[A-Za-z_][A-Za-z0-9_\-\.]+$
customTikaServerEndpoints - array[string]
Optional - If you do not want to use the Fusion's default http://tikaserver service, you can instead specify one or more alternative tika server URLs.
excludeContentTypes - array[string]
List of content types to exclude from parsing
addOriginalContent - boolean
Default: false
addFailedDocs - boolean
Default: false
includeImages - boolean
Default: false
contentEncoding - string
Default: binary
Allowed values: binarybase64
maxBytesReturned - integer
Sets the maximum amount of bytes that can be returned from the parser.
Default: 100000000
maxMetadataFieldBytes - integer
Sets the maximum amount of bytes that can be stored in each field.
Default: 30000
maxEmbeddedDocuments - integer
The maximum number of embedded documents to parse. Any additional embedded documents past this number will be ignored. If set to -1, it will parse an unlimited. If parse is set to 1, no embedded docs will be parsed. If set to 0, the parser will parse nothing.
Default: -1
parseTimeoutMs - integer
The maximum amount of time in milliseconds that a single parse can take.
Default: 15000
cleanNonAsciiText - boolean
Default: false
tikaServerClientMaxRetries - integer
Sets the max number of retries to perform. -1 indicates to retry forever
Default: 2
tikaServerClientBackOffDelayMs - integer
Sets the delay between retries, exponentially backing off to the max delay and multiplying
successive delays by the delay factor
Default: 1000
tikaServerClientBackOffMaxDelayMs - integer
Sets maximum delay that can be reached while backing off during retries
Default: 60000
tikaServerClientBackOffDelayFactor - number
Successive delays are multiplied by this factor while retrying
Default: 2
tikaServerClientRetryMaxDurationMs - integer
Sets the max duration to perform retries for, else the execution will be failed
Default: 120000
type - stringrequired
Default: tikaserver
Allowed values: tikaserver