Retrieve data from a MongoDB instance.
You can configure the Fusion MongoDB connector to read from the MongoDB
oplog rather than from the entire MongoDB collection.
In this mode, the connector crawls the full MongoDB collection, saves a checkpoint in ZooKeeper, then continues running indefinitely, grabbing updates from the
oplog as they happen in real time.
This way, the connector can delete documents that are deleted from MongoDB.
If the connector stops for any reason, it stores a timestamp in ZooKeeper that shows what the latest update was. When the connector restarts, it continues reading from that checkpoint onward.
Make sure your connector authenticates to Mongo as a user with read
oplogpermissions. See Role-based access control in the MongoDB documentation.
Make sure Process Oplog is selected in the Fusion MongoDB connector UI.