Job configuration specifications
id
field in the configuration file. Required field.script
field in the configuration file.parameter name:parameter value
options to use for Spark configuration. This is the sparkConfig
field in the configuration file.parameter name:parameter value
options to send to the Spark shell when the job is run. This is the shellOptions
field in the configuration file.parameter name:parameter value
options to bind the key:value
pairs to the Scala interpreter. This is the interpreterParams
field in the configuration file.