Create Collections in Milvus Jobs

Configuration Properties

Creates collections with specified parameters in Milvus.

Configuration Properties

Property Description, Type

allow-recreate

Override collections

If checked and there are existing collections with the same names, they will be dropped and recreated. If unchecked, the exception is thrown in such situation.

type: boolean

collections-list

Collections

List of the collections that should be created with corresponding params.

type: array of object

object attributes: {
  dimension (required) : {
    display name: Dimension
    type: integer
    description : Dimension size of vectors to be stored in the collection
    }
  indexFileSize (required) : {
    display name: Index File Size
    type: integer
    default value: '1024'
    description : Files larger than this will trigger index building for raw data files
    exclusiveMinimum : false
    minimum : 1
    }
  metric (required) : {
    display name: Metric
    type: string
    default value: 'Inner Product'
    description : Metric which should be used for vectors similarity
    enum: { Euclidean Inner Product Hamming Jaccard Tanimoto Substructure Superstructure     }

    }
  milvusCollectionName (required) : {
    display name: Collection Name
    type: string
    description : Name of the collection to create in Milvus
    pattern : ^[a-zA-Z0-9_]+$
    }
  }

Job ID

required

The ID for this job. Used in the API to reference this job. Allowed characters: a-z, A-Z, dash (-) and underscore (_)

type: string

maxLength: 63

pattern: [a-zA-Z][_\-a-zA-Z0-9]*[a-zA-Z0-9]?

readOptions

Read Options

Options used when reading input from Solr or other sources.

type: array of object

object attributes: {
  key (required) : {
    display name: Parameter Name
    type: string
    }
  value : {
    display name: Parameter Value
    type: string
    }
  }

sparkConfig

Additional parameters

Provide additional key/value pairs to be injected into the training JSON map at runtime. Values will be inserted as-is, so use " to surround string values

type: array of object

object attributes: {
  key (required) : {
    display name: Parameter Name
    type: string
    }
  value : {
    display name: Parameter Value
    type: string
    }
  }

type

Spark Job Type

required

type: string

default value: 'argo-milvus-create-collections'

enum: { argo-milvus-create-collections }

writeOptions

Write Options

Options used when writing output to Solr or other sources

type: array of object

object attributes: {
  key (required) : {
    display name: Parameter Name
    type: string
    }
  value : {
    display name: Parameter Value
    type: string
    }
  }