Veritas Technologies LLC

Symantec Corporation

Symantec Operating Corporation

Cohesity, Inc.

Other

Veritas US IP Holdings LLC

Xianbo Zhang

Weibao Wu

Haigang Wang

Haibin She

Shuangmin Zhang

Fanglu Guo

Yong Yang

Shuai Cheng

Chao Lei

Thomas Hartnett

Dongxu Sun

Jialun Liu

Kai Lin Li

Yun Yang

Wen Feng Jiang

Shengzhao Li

Cheng Shan

Timothy J Stevens

Yafeng Wang

Zhuhua Yin

Anindya Banerjee

Yu Wang

Petros Efstathopoulos

Kirk L Searls

Sanjay Sawhney

James P Ohr

Aaron Christensen

Kai Li

Xiaobing Song

Wenxin Wang

Jim R Lamb

Jeffrey Van Voorst

Yaobin Qin

Satyajit Ashok GorheParlikar

Sudhakar Paulzagade

Lulu Wei

Gaurav Makin

Sinh Nguyen

David Teater

William Joseph Browning

Satyajit Gorhe Parlikar

Richard P Jones

Mike Zeis

Steve A Vranyes

Lei Hu Zhang

Hongxing Guan

Danzhou Liu

Prabhu Damodharan

Cheng Hai Zhu

Xu Jiang

Dean Elling

Aaron Laffin

Yongguo Yan

Xinbao Jin

Sameer Kulkarni

Nilesh Joshi

Scott Brons

Benjamin Potvien

Smitha Cauligi

Chunzhong Zhang

Wim Goedertier

Changjun Bai

Patrick Ou

Jinchang Zhang

Emery Wang

Wenfeng Jiang

Disclosed are techniques that provide for deduplication in an efficient and effective manner. For example, such methods, computer program products, and computer systems can include retrieving container information for a first one or more containers of a plurality of containers of one or more backup images (where the one or more backup images were produced under an existing backup policy), generating pre-processed container information (where the generating the pre-processed container information comprises performing data pre-processing on the container information), determining a plurality of container ranges for the first one or more containers, generating container range affinity information for the one or more backup images (where the generating the container range affinity information comprises performing a container range operation using the plurality of container ranges, and storing the container range affinity information in a container range data structure.

Methods and systems for affinity-aware prefetching

Methods, computer program products, computer systems, and the like are disclosed that provide for scalable deduplication. Such methods, computer program products, and computer systems can include, in response to receiving a request to perform a lookup operation, performing the lookup operation and, in response to the signature not being found, forwarding the request to a remote node. Further, in response to receiving an indication that the signature was not found at the remote node, processing the subunit of data as a unique subunit of data.

Methods and systems for scalable deduplication

Methods, computer program products, computer systems, and the like are disclosed that provide for improved deduplication performance using prefetched backup information. For example, such methods, computer program products, and computer systems can include generating new feature information for a new backup image, (for each existing backup image in a plurality of existing backup images) comparing the new feature information with existing feature information for the each existing backup image, identifying one or more existing backup images of the plurality of existing backup images, and prefetching the one or more existing backup images. The feature information is generated as an output of a machine learning process. The machine learning process receives at least a portion of data of the new backup image as an input. The one or more existing backup images are identified based, at least in part, on a result of the comparing.

Methods and systems for improved deduplication performance using prefetched backup information

Methods, computer program products, and computer systems for the management of data references in an efficient and effective manner are disclosed. Such methods, computer program products, and computer systems include receiving a change tracking stream at the computer system, identifying a data object group, and performing a deduplication management operation on the data object group. The change tracking stream is received from a client computing system. The change tracking stream identifies one or more changes made to a plurality of data objects of the client computing system. The identifying is based, at least in part, on at least a portion of the change tracking stream. The data object group represents the plurality of data objects.

Method and system for improving efficiency in the management of data references

A method includes creating a deduplicated universal share (US) of data objects, which in turn includes receiving a US of the data objects, deduplicating the US, wherein deduplicating the US includes: hashing segments of the US to generate respective US segment fingerprints; comparing US segment fingerprints to fingerprints for respective segments held in deduplication storage in order to identify segments in the deduplication storage that equate to the US segments, respectively, of the US; storing identifiers that directly or indirectly identify locations, respectively, of the segments, respectively, in the deduplication storage that equate to the US segments, respectively, of the US. After creating the deduplicated universal share, a deduplicated backup of the US is created without reassembling the US from segments held in the deduplication storage, the creating the deduplicated backup including: creating a list that comprises copies of the stored identifiers, and storing the list.

Optimize backup from universal share

Disclosed are techniques that provide for deduplication in an efficient and effective manner. For example, such methods, computer program products, and computer systems can include generating new feature information for one or more portions of a new backup image, generating first container range information by performing a container range calculation using the new feature information, generating existing feature information for one or more portions of an existing backup image, generating second container range information by performing the container range calculation using the existing feature information, determining a container range affinity between the first container range information and the second container range information, identifying at least one portion of the one or more portions of the existing backup image using a result of the determining, and prefetching the one or more fingerprints corresponding to the at least one portion of the one or more portions of the existing backup image.

Methods and systems for affinity aware container prefetching

Methods, computer program products, computer systems, and the like for efficient metadata management are disclosed, which can include determining whether a change in a status of data has occurred. In response to a determination that the change has occurred, such methods, computer program products, and computer systems can include determining whether a move condition has been met, and, in response to a determination that the move condition has been met, moving the metadata from the first storage unit to a second storage unit.

Methods and systems for the movement of metadata between different storage types

Methods, computer program products, computer systems, and the like are disclosed that provide for scalable deduplication in an efficient and effective manner. For example, such methods, computer program products, and computer systems can include receiving a data object at an assigned node, determining whether the data object includes a sub-data object, and processing the sub-data object. The assigned node is a node of a plurality of nodes of a cluster, where the data object includes a data segment, and a signature. The signature is generated based, at least in part, on data of the data segment. The processing includes sending the sub-data object to a remote node. The remote node is another node of the plurality of nodes of the cluster.

Methods, computer program products, computer systems, and the like for efficient metadata management are disclosed, which can include receiving a subunit of storage, storing a first metadata portion of the subunit of storage in a first unit of storage, and storing a second metadata portion of the subunit of storage in a second unit of storage.

Methods and systems for efficient metadata management

Methods, computer program products, computer systems, and the like are disclosed that provide for improved write performance in erasure-coded storage systems in an efficient and effective manner. These can include identifying a data segment, identifying metadata, persisting the data segment to a storage system, storing the metadata in the journal, and persisting the metadata to the storage system. In such embodiments, the metadata is associated with the data segment by virtue of the metadata comprising a fingerprint of the data segment. Further, in such embodiments, the persisting the data segment to the storage system is performed without storing the data segment in a journal, and the storage system is an erasure-coded storage system.

Method and system for improved write performance in erasure-coded storage systems

Systems and methods for processing data segments are disclosed. In one embodiment, such functionality includes buffering data received from a node (where the data is stored in a buffer as buffered data, an offset value is associated with the data, and a segment size is associated with the buffer), and determining whether the offset value is an integer multiple of the segment size. In response to determination that the offset value is an integer multiple of the segment size, processing the data in the buffer as a segment. Such functionality also includes determining whether the segment is a duplicate of data stored in a deduplicated data store and, in response to a determination that the segment is not a duplicate of data stored in the deduplicated data store, storing the segment in the deduplicated data store.

Offset segmentation for improved inline data deduplication

Disclosed herein are systems, methods, and processes to perform replication between heterogeneous storage systems. In one embodiment, a request to perform a replication operation is sent by a target server to a source server, where the target server and the source server use different protocols to store data. A plurality of instructions, which are associated with a replication stream, are received from the source server by the target server, where the plurality of instructions comprise an include instruction to include existing data and a write instruction to write new data. A replication stream, which is associated with a backup stream stored on the source server, is also received from the source server, where the replication stream and the backup stream share a common format. The target server synthesizes a new replicated backup image, where the synthesizing comprises performing the include instruction and the write instruction on the replication stream.

Replication between heterogeneous storage systems

A method, computer program product, computer system, and the like that provide for the efficient reclamation of storage space in a deduplication system are disclosed. The method, for example, includes identifying one or more storage constructs of a number of storage constructs and generating an indication that a reclamation operation is to be performed with respect to the one or more storage constructs. In an embodiment, each of the plurality of storage constructs includes metadata and a number of units of data. The one or more storage constructs are identified, at least in part, by determining that a portion of the number of units of data of each of the one or more storage constructs is in a state, wherein the determining is based, at least in part, on at least a portion of the metadata.

Efficient space reclamation in deduplication systems

Disclosed herein are methods, systems, and processes to optimize and manage fingerprint backward compatibility in deduplication backup computing systems. A new fingerprint is generated for a segment object stored in a data container based on a new fingerprinting process. A header file is modified by replacing an old fingerprint for the segment object based on an old fingerprinting process with the new fingerprint. An entry including information indicating an association between the old fingerprint and the new fingerprint is created in a fingerprint map file.

Fingerprint backward compatibility in deduplication backup systems

Growing community of inventors

Plymouth, MN, United States of America

Xianbo Zhang