TLS must be disabled in order to use ConfigSync.
Features
ConfigSync supports these features:-
Configuration storage
- Git Repository: Stores the configuration files.
- Fusion Cluster: Applies the configuration files to the Fusion cluster.
- Kubernetes Secret: Stores the Fusion secrets.
-
Synchronization mechanisms
-
Polling:
- Periodically pulls the latest changes from the Git repository and applies them to the Fusion cluster.
- Periodically pulls the latest changes from some solr collections (blobs, rules) and pushes them to the Git repository.
-
Event-driven:
- Listens for changes in the Fusion cluster and pushes them to the Git repository.
- Listens for changes in the Kubernetes secret and syncs them with the Fusion cluster.
-
Polling:
-
Synchronization modes
- Publisher mode: Monitors Fusion for changes and pushes them to a Git repository.
- Subscriber mode: Polls a Git repository for changes and applies them to Fusion.
- Pub/Sub mode: Combines the features of both Publisher and Subscriber modes.
-
Secret management
- Supports storing Fusion secrets in a Kubernetes secret and syncing them with the Git repository.
- Watches for changes in the Kubernetes secret and syncs them with the Fusion cluster.
-
Version control
- Maintains the
latest-synced-commit
to track the last applied commit. - Supports locking the configuration to a specific commit using
locked-commit
.
- Maintains the
-
Restoring configuration
- Allows rollback to a previous state.
- Supports restoring the configurations to a specific commit, branch or date.
-
Metrics
- Exposes metrics such as
resource_update_errors_total
,out_of_sync
,sync_seconds
, andsync_seconds_max
at the/actuator/prometheus
endpoint.
- Exposes metrics such as
ConfigSync versus Cross Data Center (CrossDC) replication
Fusion supports Cross-Data Center Replication (CrossDC) in addition to ConfigSync.While ConfigSync is designed for configuration synchronization, CrossDC is designed for data replication. Here’s a comparison of the two features:
Feature | CrossDC | ConfigSync |
---|---|---|
Data replication | ||
Solr collection synchronization | ||
Rules synchronization | ||
Configuration synchronization | ||
Blob synchronization | ||
Version control (Git) | ||
ZooKeeper data | ||
Disaster recovery | For search data | For configuration only |
Latency reduction | Across geo-distributed users | Not applicable |
Typical use case | Global failover, data center redundancy | DevOps config promotion, disaster recovery for Fusion config |
When you use CrossDC, ConfigSync must also be enabled in order to mirror Solr configset data that is directly modified in ZooKeeper by Fusion instead of by the Solr ConfigSet API.
Setup
See ConfigSync deployment to set up ConfigSync on your Fusion cluster.LucidAcademyLucidworks offers free training to help you get started.The Course for ConfigSync focuses on how to synchronize your Fusion configuration with a GitHub repository:Visit the LucidAcademy to see the full training catalog.