Comm Vault Systems, Inc.

Xiangyu Wang

Avinash Lakshman

Srinivas Lakshman

Bharat Pundalik Naik

Abhijith Shenoy

Srividhya Kavaipatti Anantharamakrishnan

Lásaro Camargos

Lasaro Camargos

A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a 'container data mover' that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

Migrating data between data storage systems integrated with application orchestrators

Container data mover for migrating data between distributed data storage systems integrated with application orchestrators

Disclosed deduplication techniques at a distributed data storage system guarantee that space reclamation will not affect deduplicated data integrity even without perfect synchronization between components. By understanding certain 'behavioral' characteristics and schedule cadences of backup operations that generate backup copies received at the distributed data storage system, data blocks that are not re-written by subsequent backup copies are pro-actively aged, while promoting continued retention of data blocks that are re-written. An expiry scheme operates with block-level granularity. Each unique deduplicated data block is given an expiry timeframe based on the block's arrival time at the distributed data storage system (i.e., when a backup copy supplies the block) and further based on backup frequencies of the various virtual disks referencing a unique system-wide identifier of the block, which is based on the block's hash value. Communications between components are kept to an as-needed basis. Cloud-based and multi-cloud configurations are disclosed.

Optimized deduplication based on backup frequency in a distributed data storage system

Cloud-based distributed data storage system using block-level deduplication based on backup frequencies of incoming backup copies

Growing community of inventors

Fremont, CA, United States of America

Xiangyu Wang