Product Selector

Fusion 5.12
    Fusion 5.12

    Forked Apache Tika Parser Stage

    A simplified Apache Tika parser more geared towards an Enterprise Search crawl where all documents are parsed in a forked Java Virtual Machine. If memory issues occur during the parse, such as an Out Of Memory condition, the connector job is unaffected.

    When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.

    A simplified Apache Tika parser more geared towards an Enterprise Search crawl where all documents are parsed in a forked Java Virtual Machine. If memory issues occur during the parse, such as an Out Of Memory condition, the connector job will be unaffected.

    id - string

    Default: e74dc658-dffa-4171-bfaa-d7f7b3464c6e

    label - string

    A label for this Parser Stage

    <= 255 characters

    enabled - boolean

    Default: true

    mediaTypes - array[string]

    Documents with a media type on this list will be matched by this parser stage. See inheritMediaTypes / use default media types for more.

    inheritMediaTypes - boolean

    Each parser stage has a built-in list of media types it handles by default. If this setting is true, that list will be used along with any optional additional types provided in the mediaTypes list. If this setting is false, this stage will only be selected for media types in the mediaTypes list, and the mediaTypes list becomes a mandatory property which must have at least one valid media type.

    Default: true

    ignoredMediaTypes - array[string]

    Documents with a media type on this list will be not be processed by this parser stage.

    pathPatterns - array[object]

    Specify a file name or pattern that must be matched for this parser stage to run. Forward slashes ("/") are used to join names of files inside archives with the archive name.

    object attributes:{syntax : {
     display name: Pattern type
     type: string
    }
    pattern : {
     display name: File name or pattern
     type: string
    }
    }

    errorHandling - string

    Default: mark

    Allowed values: ignorelogfailmark

    outputFieldPrefix - string

    Fields extracted by this parser will be prefixed with this string. The remainder of the field name will be as detected in the stream

    <= 20 characters

    Match pattern: ^$|^[A-Za-z_][A-Za-z0-9_\-\.]+$

    includeImages - boolean

    Default: false

    addFailedDocs - boolean

    Default: false

    contentEncoding - string

    Default: binary

    Allowed values: binarybase64

    extractHtmlLinks - boolean

    Collect links explicitly declared in document structure (e.g. using HTML tags, bookmarks, etc)

    Default: true

    maxBytesReturned - integer

    Sets the maximum amount of bytes that can be returned from the parser.

    Default: 100000000

    parseTimeoutMs - integer

    The maximum amount of time in milliseconds that a single parse can take.

    Default: 60000

    excludeContentTypes - array[string]

    List of content types to exclude from parsing

    zipBombCompressionRatio - integer

    Maximum number of output bytes fusion will generate per input byte. If you are indexing highly compressed files, you may increase this value to avoid triggering 'Zip Bomb' detection

    Default: 200

    zipBombMaxDepth - integer

    Returns the maximum XML element nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection

    Default: 200

    zipBombMaxPackageEntryDepth - integer

    Sets the maximum package entry nesting level. If you are indexing highly nested files, you may increase this value to avoid triggering 'Zip Bomb' detection

    Default: 20

    type - stringrequired

    Default: tikafork

    Allowed values: tikafork