Lucidworks
  • Fusion Platform

    Highly scalable search engine and NoSQL datastore.

    Learn more ›

    Superior relevancy with machine learning, and artificial intelligence.

    Learn more ›

    Quickly create bespoke data applications for web and mobile.

    Learn more ›
  • AI-Powered Search
    • Augmented Intelligence
    • Machine Learning
    • Clustering
    • Query Analysis
    • Signals
    • Faceted Search
    • Indexing
    • Hyper-Personalization
  • Enterprise Solutions
    • Digital Workplace
    • Digital Commerce
    • Search Engine Replacement
    • Government
  • Resources
  • Blog
  • Try It Now
  • Search
CONTACT US

      Products

      • Fusion Server 5.0
      • Fusion AI 5.0
      • Managed Search
      • Fusion Server 4.2
      • Fusion AI 4.2
      • Fusion App Studio 4.2
      • Fusion Server 4.1
      • Fusion AI 4.1
      • Fusion App Studio 4.1
      • Fusion Server 4.0
      • Fusion AI 4.0
      • Fusion App Studio 4.0
      • Lucidworks Cloud
      • Fusion 3.1
      • Fusion 3.0
      • LucidWorks HDP Search
      • LWS
      • Solr Modules

      Overview

      User Guide  (PDF)

      • Query Rewriting
        • Business Rules
        • Simulator
        • Underperforming Query Rewriting
        • Misspelling Detection
        • Phrase Detection
        • Synonym Detection
      • Response Rewriting
      • Natural Language Processing
      • Signals and Aggregations
        • Signals
        • Aggregations
          • Creating Aggregations
          • SQL Aggregations
      • Recommendations and Boosting
        • Content-based Filtering
        • Collaborative Filtering
        • Similarities
        • Multiple Recommenders
        • Configure Recommendations and Boosting
      • Machine Learning
        • Machine Learning Models in Fusion
        • Machine Learning Jobs
        • Spark in Kubernetes
          • Configuring credentials in the Kubernetes cluster
          • How to get logs for a Spark job
          • Pod cleanup
        • Spark in Fusion On-Prem
          • Spark Getting Started
          • Spark Components
          • Spark Driver Processes
          • Spark Configuration
          • Scaling Spark Aggregations
          • Spark Troubleshooting
        • Data Science Toolkit Integration
          • Installing the DSTI
          • Using the DSTI
          • Building a Custom ML Service Image
      • Experiments
        • Plan an Experiment
        • Experiment Metrics
        • Set Up an Experiment
        • Set Up an Experiment Stage
        • Run an Experiment
        • Analyze Experiment Results
      • App Insights
        • Dashboards
        • Events
        • Sessions
        • Analytics
        • Experiment Results
        • Reports and Signal Data Requirements
      • Import Data with the Parallel Bulk Loader
      • Licensing

      Reference Guides  (PDF)

      • Index Pipeline Stages
        • Format Signals
        • Machine Learning
        • NLP Annotator
        • OpenNLP NER Extraction
        • Update Experiment
      • Query Pipeline Stages
        • Analytics Catalog
        • Apply Rules
        • Boost Documents
        • Boost With Signals
        • Experiment
        • Machine Learning
        • Machine Learning (Responses)
        • NLP Annotator
        • Parameterized Boosting
        • Recommend Items For Item
        • Recommend Items For User
        • Recommend More Like This
        • Response Document Exclusion Stage
        • Response Document Field Redaction Stage
        • Response Pairwise Swap
        • Response Shuffle Stage
        • Text Tagger Stage
      • Jobs
        • ALS Recommender Jobs
        • Cluster Labeling Jobs
        • Document Clustering Jobs
        • Ground Truth Jobs
        • Head/Tail Analysis Jobs
        • Logistic Regression Classifier Training Jobs
        • Outlier Detection Jobs
        • Parallel Bulk Loader Jobs
        • Parameterized SQL Aggregation Jobs
        • Phrase Extraction Jobs
        • Query-to-Query Similarity Jobs
        • Random Forest Classifier Training Jobs
        • Ranking Metrics Jobs
        • SQL-Based Experiment Metric Jobs
        • Synonym and Similar Queries Detection Jobs
        • Token and Phrase Spell Correction Jobs
        • Word2Vec Model Training Jobs
      • REST API Reference
        • Experiments API
        • Query Rewrite API
        • Recommendations API
        • Signals API

      Release Notes

      Spark Administration in Kubernetes

      • Related topics

      Unresolved directive in index.asciidoc - include::https://raw.githubusercontent.com/lucidworks/fusion-distributed-compute/releases/5.0.x/job-launcher/src/docs/asciidoc/public-docs/spark.adoc?token=ACCTAY7C4CQPVFBZ5PUMFJ25RFLY4[tag=overview]

      Related topics

      • Configuring credentials in the Kubernetes cluster

      • How to get logs for a Spark job

      • Pod cleanup

      • Jobs and Schedules

      • Spark Jobs

      • Spark jobs for Fusion AI

      Lucidworks
      • Company
      • Press
      • Careers
      • Services
      • Partners
      • Blog
      • Labs
      • Resources
      • Events
      • Documentation
      • Annual Conference
      • Fusion Platform
      • AI-Powered Search
      • Enterprise Solutions
      • Contact

      235 MONTGOMERY ST
      SUITE 500
      SAN FRANCISCO, CA 94104

      (415) 329-6515

      Follow Us

      TRY IT NOW

      © 2019 Lucidworks

      • Legal Agreements
      • Privacy Policy
      • Sitemap