Looking for the old site?

How To

Browse By

  • Objective

  • Products

  • User Role

    How To
      Learn More

        Clean Up Spark Driver Pods

        Spark driver pods are cleaned up using a Kubernetes cron job that runs every 15 minutes to clean up pods using this command:

        kubectl delete pods --namespace default --field-selector=status.phase=Succeeded -l spark-role=driver

        This cron job is created automatically when the job-launcher microservice is installed in the Fusion cluster.

        For related topics, see Spark Operations.