Optimized Incremental Scans Using Qumulo Native Change File Tracking APIs

Qumulo REST APIs provide capabilities for optimized scan and backup performance.

Qumulo REST APIs

Qumulo REST APIs provide the following capabilities for optimized scan and backup performance:

  • An incremental scan operation creates snapshots and performs change file tracking.

  • A Change File Tracking operation determines which files changed between the previous and current backup snapshots. This requires inbound access to TCP 8000 on the Qumulo devices.

  • The scan and backup operations read data from the snapshots, to shift load from production data shares. To offload production data shares, two snapshots are created and retained: one for the current backup operation and the other for the previous backup operation.

Performance Metrics for Regular and Qumulo Operations

File count: 100 million

File size: Mixed file size

The following tables compare performance metrics between regular scans and Qumulo scans of CIFS share and NFS export snapshots, of new files and modified files.

CIFS

                                                               
Backup typeItemsQumulo CFT scan time
FullNot applicable02:39:00
Incremental1 million, modified files00:30:00
Incremental1 million, new files under a new folder00:03:40

NFS

                                                               
Backup typeItemsQumulo CFT scan time
FullNot applicable03:07:00
Incremental1 million, modified files00:37:00
Incremental1 million, new files under 1000 new folders00:15:00

Loading...