Connectors

Connectors are the built-in mechanism for pulling your data into Fusion. Fusion comes with a wide variety of connectors, each specialized for a particular data type. When you add a datasource to a collection, you specify the connector to use for ingesting data. See the list of connectors for a complete list of connectors, with links to configuration reference information for each one.

Connector configuration

When you add a datasource to a collection, you select a connector and configure it. There are two ways to do this:

  • Using the API

  • Using the UI

Configuring Connectors Using The API

You can create or update a datasource with the Connector Datasources API, specifying the connector, its properties, and their values.

Example: Create and configure a datasource to index Solr-formatted XML files
curl -u user:pass -X POST -H 'Content-type: application/json' -d '{"id":"SolrXML", "connector":"lucid.solrxml", "type":"solrxml", "properties":{"path":"/Applications/solr-4.10.2/example/exampledocs", "generate_unique_key":false, "collection":"MyCollection"}}' http://localhost:8764/api/apollo/connectors/datasources

See the Connectors and Datasources Reference for details about configuration options.

Tip
Be sure the include the collection property; otherwise the datasource will not be available in the Fusion UI.
Example: Change the max_docs value for the above datasource
curl -u user:pass -X PUT -H 'Content-type: application/json' -d '{"id":"SolrXML", "connector":"lucid.solrxml", "type":"solrxml", "properties":{"path":"/Applications/solr-4.10.2/example/exampledocs", "max_docs":10}}' http://localhost:8764/api/apollo/connectors/datasources/SolrXML

Configuring Connectors Using The Fusion UI

  • To create and configure a new datasource and its connector:

    1. Click Applications > Collections.

    2. Select a Collection, or click Add a Collection to create a new one.

    3. Click Add a Datasource.

    4. Select a datasource type; these correspond to Fusion’s Connectors.

    5. Edit the configuration fields in the datasource panel that appears.

      See the Connectors and Datasources Reference for details about configuration options.

    6. Click Save.

  • To change the connector configuration for an existing datasource:

    1. Navigate to Applications > Collections.

    2. Click your collection name.

    3. Click the datasource you want to change.

    4. Edit the configuration fields as needed.

    5. Click Save.

Connector logs

You can find connector logs in fusion/var/log/connectors.