1. System Administration

Jobs and Schedules

The Jobs API allows you to view jobs and their run histories, configure their schedules, and control them directly.

In the Fusion UI, jobs are accessible in the Search context, while schedules are in the DevOps context.

  • A job is a runnable Fusion object.

    Datasources, Spark jobs, and tasks are all jobs.

  • A schedule defines when Fusion will perform a job.

    A job can be scheduled using cron notation, ISO-8601 interval definitions, or using triggers that depend on the results of other jobs.

Job types

Each job type is a type of Fusion object that you can run or schedule to be run.

datasource

A job to ingest data according to the specified datasource configuration, such as datasource:movie-db. Datasources are created using the Connector Datasources API or the Fusion UI.

See Datasource Jobs.

spark

A Spark job to process data, such as spark:dailyMetricsRollup-counters. Spark jobs are created using the Spark Jobs API or the Fusion UI.

See Spark Jobs.

task

A job to perform an HTTP call or log cleanup, such as task:delete-old-system-logs. Tasks are created using the Tasks API or the Fusion UI.

See Tasks.

The Jobs manager

The Jobs manager, available in the Fusion UI at Search > Jobs, provides a simple interface for viewing and scheduling jobs. Tasks and Spark jobs can also be created here.

Datasource jobs cannot be created, run, or scheduled here. They must be created on the Datasources page, in the Index Workbench, or in the Quickstart. To run a datasource once, go to Search > Datasources or DevOps > Scheduler. To schedule a datasource job, go to DevOps > Scheduler.

To create a new job

  1. Click Add and select the job type.

    New Job

    The New Job Configuration panel appears. This panel is different for each job type. See the job types above for details.

  2. Configure the new job as needed.

  3. Click Save.

To run a job once

  1. Select the job from the job list.

  2. Click Run.

  3. Click Start.

    Start Job

To schedule a job

  1. Select the job from the job list.

  2. Click Run.

  3. Click New Schedule.

    Schedule Job

  4. Select a job trigger:

    • After Another Job Completes

      Enter the job ID and job result that trigger this one.

      job trigger1

    • Cron String

      Enter a crontab expression.

      job trigger2

    • Start + Interval

      Enter a start date/time, an interval, and the interval units.

      job trigger3

The Scheduler

The Scheduler, available in the Fusion UI at DevOps > Scheduler, provides an interface for scheduling jobs. Jobs cannot be created here; to create new schedulable objects, use the Jobs manager, or the REST API for each job type.

Scheduler