Getting Data In

Data ingestion gets your data into Fusion Server, and data indexing stores it in a format that’s optimized for searching. These topics explain how to get your data into Fusion Server in a search-optimized format.

  • Collections are a way of grouping data sets so that related data sets can be managed together. Every data set that you ingest belongs to a collection. Any app can contain one or more collections. See Collection Management.

  • Datasources are configurations that determine how your data is handled during ingest by Fusion Server’s connectors, parsers, and index pipelines. When you run a fully-configured datasource, the result is an indexed data set that’s optimized for search, depending on the shape of your data and how you want to search it. See Datasource Configuration.

  • In some cases, you might find that it’s best to use other ingestion methods, such as Hive, Pig, or pushing data to a REST API endpoint.

  • Blob storage is a way to upload binary data to Fusion Server. This can be your own data, such as images or executables, or it can be plugins for Fusion Server, such as connectors, JDBC drivers, and so on.