Solr UpdateParser stage configuration specifications
The Solr Update Parser stage parses Solr’s "update" messages and transforms them into Managed Fusion PipelineDocuments. This makes it possible to integrate with existing datasets that happen to be in Solr’s "update" format and send them to an index pipeline.
This parser stage supports XML, JSON, CSV and JavaBin.
|
|
When parsing CSV files, consider using the CSV parser, which provides more options than the Solr Update Parser. All CSV files are treated the same in terms of structure and schema.
|
The https://EXAMPLE_COMPANY.lucidworks.cloud/apps/solr-dist/example/exampledocs/ directory contains many of these "update" format documents. Managed Fusion also ships with a https://EXAMPLE_COMPANY.lucidworks.cloud/apps/solr-dist/bin/post utility which is used to index documents from the file system. However, the post utility has no way of integrating with Managed Fusion; its output is sent directly to Solr.
|
|
Replace EXAMPLE_COMPANY with the name provided by your Lucidworks representative.
|
|
|
When entering configuration values in the UI, use unescaped characters, such as \t for the tab character. When entering configuration values in the API, use escaped characters, such as \\t for the tab character.
|
Parser for Solr "update" messages (xml, json, csv and javabin).
id - string
Default: db7a6b09-efa7-4645-8f5c-3e13cf3f7fc2
label - string
A label for this Parser Stage
<= 255 characters
enabled - boolean
Default: true
mediaTypes - array[string]
Documents with a media type on this list will be matched by this parser stage. See inheritMediaTypes / use default media types for more.
inheritMediaTypes - boolean
Each parser stage has a built-in list of media types it handles by default. If this setting is true, that list will be used along with any optional additional types provided in the mediaTypes list. If this setting is false, this stage will only be selected for media types in the mediaTypes list, and the mediaTypes list becomes a mandatory property which must have at least one valid media type.
Default: true
ignoredMediaTypes - array[string]
Documents with a media type on this list will be not be processed by this parser stage.
pathPatterns - array[object]
Specify a file name or pattern that must be matched for this parser stage to run. Forward slashes ("/") are used to join names of files inside archives with the archive name.
object attributes:{syntax : {
display name: Pattern type
type: string
}pattern : {
display name: File name or pattern
type: string
}}
errorHandling - string
Default: mark
Allowed values: ignorelogfailmark
outputFieldPrefix - string
Fields extracted by this parser will be prefixed with this string. The remainder of the field name will be as detected in the stream
<= 20 characters
Match pattern: ^$|^[A-Za-z_][A-Za-z0-9_\-\.]+$
enableCsv - boolean
Enables the parser to recognize and parse, CSV based Solr update messages.
Default: true
enableXml - boolean
Enables the parser to recognize and parse, XML based Solr update messages.
Default: true
enableJson - boolean
Enables the parser to recognize and parse, JSON based Solr update messages.
Default: true
type - stringrequired
Default: solr-update
Allowed values: solr-update