Blob Storage

Fusion accepts large binary objects (blobs) for upload, and stores them in Solr. Blob uploads are used to install models, lookup lists, JDBC drivers, connectors, and more.

Blob Types

A resourceType query parameter can be used to specify the a blob type. For example, specify plugin:connector when uploading a connector, like this:

curl -H 'content-type:application/zip' -X PUT 'fusion-host:{api-port}/api/blobs/myplugin?resourceType=plugin:connector' --data-binary @myplugin.zip

The complete list of valid values for resourceType is below:

Type	Description
`banana`	A Banana dashboard
`catalog`	An analytics catalog
`driver:jdbc`	A JDBC Driver uploaded to Fusion Server
`file:js-index`	A JavaScript file for use with a Managed Javascript index stage.
`file:js-query`	A JavaScript file for use with a Managed Javascript query stage.
`file`	Any uploaded file, such as from the Quickstart or the Index Workbench.
`model:ml-model`	A machine learning model (Fusion AI only)
`model:open-nlp`	An OpenNLP model (Fusion AI only)
`other`	A blob of unknown type If no `resourceType` is specified on upload, “other” is assigned by default.
`plugin:connector`	A Fusion 4.x connector

Upload a JDBC Driver to Fusion Server

The JDBC connector fetches documents from a relational database via SQL queries. Under the hood, this connector implements the Solr DataImportHandler (DIH) plugin.Fusion stores JDBC drivers in the blob store. You can upload a driver using the Fusion UI or the Blob Store API.

The JDBC V1 connector is supported in Fusion releases 5.3 and earlier.
The JDBC V2 connector is supported in Fusion releases 5.4 and later.

How to upload a JDBC driver using the Fusion UI

In the Fusion UI, navigate to System > Blobs.
Click Add.
Select JDBC Driver. The “New ‘JDBC Driver’ Upload” panel appears.
Click Choose File and select the .jar file from your file system.
Click Upload. The new driver’s blob manifest appears.

From this screen you can also delete or replace the driver.

How to install a JDBC driver using the API

Upload the JAR file to Fusion’s blob store using the /blobs/{id} endpoint. Specify an arbitrary blob ID, and a resourceType value of plugin:connector, as in this example:

curl -u USERNAME:PASSWORD -H "content-type:application/java-archive" -H "content-length:707261" -X PUT --data-binary @postgresql-42.0.0.jar http://localhost:8764/api/blobs/mydriver?resourceType=driver:jdbc

Success response:

{
  "name" : "mydriver",
  "contentType" : "application/java-archive",
  "size" : 707261,
  "modifiedTime" : "2017-06-09T19:00:48.919Z",
  "version" : 0,
  "md5" : "c67163ca764bfe632f28229c142131b5",
  "metadata" : {
    "subtype" : "driver:jdbc",
    "drivers" : "org.postgresql.Driver",
    "resourceType" : "driver:jdbc"
  }
}

Fusion automatically publishes the event to the cluster, and the listeners perform the driver installation process on each node.

If the blob ID is identical to an existing one, the old driver will be uninstalled and the new driver will installed in its place. To get the list of existing blob IDs, run: curl -u USERNAME:PASSWORD https://FUSION_HOST:FUSION_PORT/api/blobs

To verify the uploaded driver, run:

curl -u USERNAME:PASSWORD https://FUSION_HOST:FUSION_PORT/api/blobs/BLOB_ID/manifest

Where the BLOB_ID is the name specified during upload, such as “mydriver” above. A success response looks like this:

{
  "name" : "mydriver",
  "contentType" : "application/java-archive",
  "size" : 707261,
  "modifiedTime" : "2017-06-09T19:05:17.897Z",
  "version" : 1569755095787110400,
  "md5" : "c67163ca764bfe632f28229c142131b5",
  "metadata" : {
    "subtype" : "driver:jdbc",
    "drivers" : "org.postgresql.Driver",
    "resourceType" : "driver:jdbc"
  }
}

How to manually upload a JDBC V1 driver for Fusion 4.x.x releases

For Fusion 4.x.x release levels, it is recommended that you upload the JDBC driver jar files manually. This prevents some issues with dynamically loading the driver causing errors, particularly with Oracle and Microsoft SQL drivers.The following steps specify how to upload a JDBC driver JAR file to Fusion manually. The example uses the Microsoft SQL Server JDBC driver mssql-jdbc-6.6.2-jre8.jar file.

Delete the JDBC V1 driver uploaded using the Blob store upload window.
Save the JDBC V1 driver JAR file to the apps/lib folder. For example: apps\libs\mssql-jdbc-6.2.2.jre8.jar
Open the apps/jetty/connectors-classic/webapps/connectors-extra-classpath.txt file and add the following line: apps/libs/mssql-jdbc-6.2.2.jre8.jar
Restart connectors-classic.
Specify the JDBC driver class name in the Manually uploaded JDBC Driver Name field.
Enter com.microsoft.sqlserver.jdbc.SQLServerDriver in the JDBC Driver Name field.

Quickstart

Install a Connector - Fusion 4.x

In Fusion 4.x, connectors are installed by uploading them to the blob store. You can use any of these methods to install a connector:

By installing connectors as “bootstrap plugins”, that is, by putting them in the bootstrap-plugins directory during initial installation or an upgrade
By using the Blob Store UI after installation or an upgrade
By using the Blob Store API after installation or an upgrade.

During upgrades, the migrator handles some aspects of installing connectors. Depending on the target version and the presence or absence of an Internet connection, there might be manual steps. Installing connectors during upgrades is explained where needed in the upgrade procedures.

After you install a connector, you can Configure A New Datasource.

You can view and download all current and previous V2 connector releases at plugins.lucidworks.com.

Install a connector as a bootstrap plugin

Fusion can install connectors as “bootstrap plugins.” All this means is that you put the connector zip files in a specific directory named bootstrap-plugins, and Fusion installs the connectors the first time it starts during initial installation or an upgrade.

Download the connector zip file from Fusion 4.x Connector Downloads. Do not expand the archive; Fusion consumes it as-is. Also, do not start Fusion until instructed to do so by the installation or upgrade instructions.
Under the version-numbered Fusion directory, place the connector in the directory apps/connectors/bootstrap-plugins/ (on Unix) or \apps\connectors\bootstrap-plugins\ (on Windows).
Start Fusion when instructed to do so in the installation or upgrade procedure.

Install a connector using the Blob Store UI

Download the connector zip file from Fusion 4.x Connector Downloads.
Do not expand the archive; Fusion consumes it as-is.
In the Fusion workspace, navigate to System > Blobs.
Click Add.
Select Connector Plugin. The “New Connector Plugin Upload” panel appears.
Click Choose File and select the downloaded zip file from your file system.
Click Upload. The new connector’s blob manifest appears. From this screen you can also delete or replace the connector.

Install a connector using the Blob Store API

Download the connector zip file from Fusion 4.x Connector Downloads.
Do not expand the archive; Fusion consumes it as-is.
Upload the connector zip file to Fusion’s blob store. Specify an arbitrary blob ID, and a resourceType value of plugin:connector, as in this example:
```
curl -H 'content-type:application/zip' -X PUT 'localhost:8764/api/blobs/myplugin?resourceType=plugin:connector' --data-binary @myplugin.zip
```
Fusion automatically publishes the event to the cluster, and the listeners perform the connector installation process on each node.
If the blob ID is identical to an existing one, the old connector will be uninstalled and the new connector will installed in its place. To get the list of existing blob IDs, run: curl -u USERNAME:PASSWORD localhost:8764/api/blobs
Look in https://FUSION_HOST:FUSION_PORT/apps/connectors/plugins/ to verify the new connector is installed.

Reinstall a connector

To reinstall a connector for any reason, first delete the connector then use the preceding steps to install it again. This may take a few minutes to complete depending on how quickly the pods are deleted and recreated.

The Blob manager

In addition to the Blob Store API, the Fusion UI provides an interface to the blob store in the Fusion workspace at System > Blobs:

Click Add to upload a new blob:
Select an uploaded blob to view, replace, or delete it:

Fusion Server

Fusion AI

App Studio

Blob Types

How to upload a JDBC driver using the Fusion UI

How to install a JDBC driver using the API

How to manually upload a JDBC V1 driver for Fusion 4.x.x releases

Step through the Quickstart wizard

Install a connector as a bootstrap plugin

Install a connector using the Blob Store UI

Install a connector using the Blob Store API

Reinstall a connector

The Blob manager

Fusion Server

Fusion AI

App Studio

​Blob Types

​The Blob manager

Blob Types

The Blob manager