Product Selector

Fusion 5.9
    Fusion 5.9

    Jobs and scheduling

    A job is a runnable Managed Fusion object that performs a specific activity, such as datasource jobs and Spark jobs. Examples of the activities include:

    • Aggregating signal data

    • Training a shallow neural model and projecting each document onto the resulting vector embedding space

    • Loading data into a data source

    Job types

    Each job type is a type of Managed Fusion object that you can run or schedule to be run.

    datasource

    A job to ingest data according to the specified datasource configuration, such as datasource:movie-db. Datasources are created using the Connector Datasources API or the Managed Fusion UI.

    spark

    A Spark job to process data, such as spark:dailyMetricsRollup-counters. Spark jobs are created using the Spark Jobs API or the Managed Fusion UI.

    See Spark Jobs.

    The Jobs manager

    The Jobs manager, available in the Managed Fusion workspace at Collections > Jobs, provides a simple interface for viewing and scheduling jobs. You can also create tasks and Spark jobs here.

    You cannot create, run, or schedule datasource jobs in the Jobs manager. You must create them on the Datasources page, in the Index Workbench, or in the Quickstart. To run a datasource job, use the scheduler.

    Additional resources

    Lucidworks offers free training to help you get started with Fusion. Check out the Managing and Scheduling Jobs quick learning, which focuses on how to create, configure, and schedule jobs using the Fusion UI:

    Managing and Scheduling Jobs

    Visit the LucidAcademy to see the full training catalog.

    Lucidworks offers free training to help you get started with Fusion. Check out the Jobs and Scheduling course, which focuses on utilizing and managing different job types in Fusion:

    Jobs and Scheduling

    Visit the LucidAcademy to see the full training catalog.