Importing Data with Connectors
Connectors are the built-in mechanism for pulling your data into Fusion. Fusion comes with a wide variety of connectors, each specialized for a particular data type. When you add a datasource to a collection, you specify the connector to use for ingesting data. See Connector Types for a complete list of connectors, with links to configuration reference information for each one.
Connector configuration
When you add a datasource to a collection, you select a connector and configure it. There are two ways to do this:
-
Using the API
-
Using the UI
Configuring Connectors Using The API
You can create or update a datasource with the Connector Datasources API, specifying the connector, its properties, and their values.
curl -u user:pass -X POST -H 'Content-type: application/json' -d '{"id":"SolrXML", "connector":"lucid.solrxml", "type":"solrxml", "properties":{"path":"/Applications/solr-4.10.2/example/exampledocs", "generate_unique_key":false, "collection":"MyCollection"}}' http://localhost:8764/api/apollo/connectors/datasources
See the Connectors and Datasources Reference for details about configuration options.
Tip
|
Be sure the include the collection property; otherwise the datasource will not be available in the Fusion UI.
|
max_docs
value for the above datasource
curl -u user:pass -X PUT -H 'Content-type: application/json' -d '{"id":"SolrXML", "connector":"lucid.solrxml", "type":"solrxml", "properties":{"path":"/Applications/solr-4.10.2/example/exampledocs", "max_docs":10}}' http://localhost:8764/api/apollo/connectors/datasources/SolrXML
Configuring Connectors Using The Fusion UI
-
To create and configure a new datasource and its connector:
-
Click Applications > Collections.
-
Select a Collection, or click Add a Collection to create a new one.
-
Click Add a Datasource.
-
Select a datasource type; these correspond to Fusion’s Connectors.
-
Edit the configuration fields in the datasource panel that appears.
See the Connectors and Datasources Reference for details about configuration options.
-
Click Save.
-
-
To change the connector configuration for an existing datasource:
-
Navigate to Applications > Collections.
-
Click your collection name.
-
Click the datasource you want to change.
-
Edit the configuration fields as needed.
-
Click Save.
-