Product Selector

Fusion 5.9
    Fusion 5.9

    Create the Upload Model Parameters to Cloud job

    The Upload Model Parameters to Cloud job lets you store a trained model’s training to a blob in cloud storage.

    This document describes the steps to create the Upload Model Parameters to Cloud job and deploy a model with it.

    For more information, see Upload model parameters to Cloud.

    Deploy a model​

    First, deploy a Smart Answers supervised model.

    Create the job

    1. Sign in to Managed Fusion and click your application.

    2. Click Collections > Jobs > Add+ > Upload Model Parameters to Cloud to create a new instance of that job.

    3. In the job ID field, enter a value of upload-cloud or a value appropriate for your model.

    4. In the Model Name field, locate the name of the deployed model.

    5. In the Cloud Path field, enter the location to store the parameters blob.

      You will also need to provide the Kubernetes secret that provides the access details for the cloud storage path. ​

    6. Run the job, then check the cloud storage location to verify that the parameter file has been saved.

      The exported file will also have the version number (based on epoch time) of the model appended to it.

    Take note of the full cloud path; you will need it to deploy the job later.

    Creating the Job

    GCS

    1. Obtain the Google Cloud Storage credentials JSON file for accessing the storage bucket you intend to use for transferring models.

    2. Add the credentials JSON file as a secret with the following command: ​

    kubectl create secret generic model-cloud-secret --from-file=credentials.json -n [NAMESPACE]

    S3

    1. Create a JSON file with the following keys:

    ”region” is optional and will be set to us-east-1 if a value is not entered ​ 
    {
   "key": [KEY],
   "secret": [SECRET],
   "region": [REGION]
}

    1. Upload the JSON file as a secret in the cluster: ​

    kubectl create secret generic model-cloud-secret --from-file=model.json -n [NAMESPACE]

    The secret can now be referenced as model-cloud-secret in the job configuration.

    Azure Blob Storage

    1. Create a JSON file with the layout below: ​

    {
   "key": [KEY],
   "secret": [SECRET]
}

    1. Create the model-cloud-secret secret in the Kubernetes cluster:

    kubectl create secret generic model-cloud-secret --from-file=model.json -n [NAMESPACE]

    Deploy a new model with the Upload Model Parameters job

    The new model can run in either the same Managed Fusion cluster or a different cluster.

    If you are planning to transfer a model to a different cluster, note that you will need to set up the Kubernetes secrets in that cluster as well, though the access for deploying can be limited to read-only.

    1. Click to create new Create Seldon Core Model Deployment job and toggle Advanced.

    2. Enter the full cloud path, including the version number, in the Cloud Path box.

    3. Enter the Kubernetes secret that will be used to access the path in the Kubernetes Secret Name for Cloud Storage Access box. ​

    4. For this example, you will be using the job to deploy a trained Smart Answers model, so use the fusion-question-answering-seldon:5.4.0 model image from the lucidworks repository in the Image Name box.

    Deploying the model

    1. Run the job. Confirm that the model deploys into the cluster and is running.