Lucidworks
  • Fusion Platform

    Highly scalable search engine and NoSQL datastore.

    Learn more ›

    Superior relevancy with machine learning, and artificial intelligence.

    Learn more ›

    Quickly create bespoke data applications for web and mobile.

    Learn more ›
  • AI-Powered Search
    • Augmented Intelligence
    • Machine Learning
    • Clustering
    • Query Analysis
    • Signals
    • Faceted Search
    • Indexing
    • Hyper-Personalization
  • Enterprise Solutions
    • Digital Workplace
    • Digital Commerce
    • Search Engine Replacement
    • Government
  • Resources
  • Blog
  • Try It Now
  • Search
CONTACT US

    Products

    • Fusion Server 5.0
    • Fusion AI 5.0
    • Predictive Merchandiser
    • Managed Search
    • Fusion Server 4.2
    • Fusion AI 4.2
    • Fusion App Studio 4.2
    • Fusion Server 4.1
    • Fusion AI 4.1
    • Fusion App Studio 4.1
    • Fusion Server 4.0
    • Fusion AI 4.0
    • Fusion App Studio 4.0
    • Lucidworks Cloud
    • Fusion 3.1
    • Fusion 3.0
    • LucidWorks HDP Search
    • LWS
    • Solr Modules

    Overview

    User Guide  (PDF)

    • Query Rewriting
      • Business Rules
      • Simulator
      • Underperforming Query Rewriting
      • Misspelling Detection
      • Phrase Detection
      • Synonym Detection
    • Response Rewriting
    • Natural Language Processing
    • Signals and Aggregations
      • Signals
      • Aggregations
        • Creating Aggregations
        • SQL Aggregations
    • Recommendations and Boosting
      • Content-based Filtering
      • Collaborative Filtering
      • Similarities
      • Multiple Recommenders
      • Configure Recommendations and Boosting
    • Machine Learning
      • Machine Learning Models in Fusion
      • Machine Learning Jobs
      • Spark in Kubernetes
        • Configuring credentials in the Kubernetes cluster
        • How to get logs for a Spark job
        • Pod cleanup
      • Spark in Fusion On-Prem
        • Spark Getting Started
        • Spark Components
        • Spark Driver Processes
        • Spark Configuration
        • Scaling Spark Aggregations
        • Spark Troubleshooting
      • Data Science Toolkit Integration
        • Installing the DSTI
        • Using the DSTI
        • Building a Custom ML Service Image
    • Experiments
      • Plan an Experiment
      • Experiment Metrics
      • Set Up an Experiment
      • Set Up an Experiment Stage
      • Run an Experiment
      • Analyze Experiment Results
    • App Insights
      • Dashboards
      • Events
      • Sessions
      • Analytics
      • Experiment Results
      • Reports and Signal Data Requirements
    • Import Data with the Parallel Bulk Loader
    • Licensing

    Reference Guides  (PDF)

    • Index Pipeline Stages
      • Format Signals
      • Machine Learning
      • NLP Annotator
      • OpenNLP NER Extraction
      • Update Experiment
    • Query Pipeline Stages
      • Analytics Catalog
      • Apply Rules
      • Boost Documents
      • Boost With Signals
      • Experiment
      • Machine Learning
      • Machine Learning (Responses)
      • NLP Annotator
      • Parameterized Boosting
      • Recommend Items For Item
      • Recommend Items For User
      • Recommend More Like This
      • Response Document Exclusion Stage
      • Response Document Field Redaction Stage
      • Response Pairwise Swap
      • Response Shuffle Stage
      • Text Tagger Stage
    • Jobs
      • ALS Recommender Jobs
      • Cluster Labeling Jobs
      • Document Clustering Jobs
      • Ground Truth Jobs
      • Head/Tail Analysis Jobs
      • Logistic Regression Classifier Training Jobs
      • Outlier Detection Jobs
      • Parallel Bulk Loader Jobs
      • Parameterized SQL Aggregation Jobs
      • Phrase Extraction Jobs
      • Query-to-Query Similarity Jobs
      • Random Forest Classifier Training Jobs
      • Ranking Metrics Jobs
      • SQL-Based Experiment Metric Jobs
      • Synonym and Similar Queries Detection Jobs
      • Token and Phrase Spell Correction Jobs
      • Word2Vec Model Training Jobs
    • REST API Reference
      • Experiments API
      • Query Rewrite API
      • Recommendations API
      • Signals API

    Release Notes

    Spark Administration in Kubernetes

    • Related topics

    Unresolved directive in index.asciidoc - include::https://raw.githubusercontent.com/lucidworks/fusion-distributed-compute/releases/5.0.x/job-launcher/src/docs/asciidoc/public-docs/spark.adoc?token=AC3KDYC5W52KW2TPVFULFBS5XCGP4[tag=overview]

    Related topics

    • Configuring credentials in the Kubernetes cluster

    • How to get logs for a Spark job

    • Pod cleanup

    • Jobs and Schedules

    • Spark Jobs

    • Spark jobs for Fusion AI

    Lucidworks
    • Company
    • Press
    • Careers
    • Services
    • Partners
    • Blog
    • Labs
    • Resources
    • Events
    • Documentation
    • Annual Conference
    • Fusion Platform
    • AI-Powered Search
    • Enterprise Solutions
    • Contact

    235 MONTGOMERY ST
    SUITE 500
    SAN FRANCISCO, CA 94104

    (415) 329-6515

    Follow Us

    TRY IT NOW

    © 2019 Lucidworks

    • Legal Agreements
    • Privacy Policy
    • Sitemap