Veritas Technologies LLC

Symantec Corporation

Chinese Academy of Sciences

Haigang Wang

Xianbo Zhang

Haibin She

Weibao Wu

Yong Yang

Chao Lei

Shuangmin Zhang

Jeffrey Van Voorst

Kai Lin Li

Fanglu Guo

Yun Yang

Ming Gao

Dongyu Wang

Shuai Cheng

Yafeng Wang

Wen Feng Jiang

Xiaofang Wang

Guoliang Song

Yunkai Sun

Dongxu Sun

Yongjie Na

Hongxing Guan

Danzhou Liu

Qinggang Lu

Lulu Wei

Sameer Kulkarni

Nilesh Joshi

Scott Brons

Wim Goedertier

Methods, computer program products, computer systems, and the like are disclosed that provide for scalable deduplication in an efficient and effective manner. For example, such methods, computer program products, and computer systems can include receiving a data object at an assigned node, determining whether the data object includes a sub-data object, and processing the sub-data object. The assigned node is a node of a plurality of nodes of a cluster, where the data object includes a data segment, and a signature. The signature is generated based, at least in part, on data of the data segment. The processing includes sending the sub-data object to a remote node. The remote node is another node of the plurality of nodes of the cluster.

Methods and systems for scalable deduplication

The disclosed computer-implemented method for data placement in container-based storage systems may include (i) identifying a file stored within a container-based storage system, where the container-based storage system stores the file as data segments within containers, (ii) receiving, in response to a write operation directed to the file, a request to store within the container-based storage system a new data segment generated by the write operation, (iii) describing the file in terms of a plurality of consecutive slabs, (iv) determining that the new data segment falls within a specified slab, and (v) fulfilling the request to store the new data segment within the container-based storage system by storing the new data segment in a designated container that corresponds to the specified slab in response to determining that the new data segment falls within the specified slab. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for data placement in container-based storage systems

Various systems, methods, and processes for caching and referencing multiple fingerprints while data operations are ongoing are disclosed. A first fingerprint is generated based on a first fingerprinting process. The first fingerprint is stored in association with a second fingerprint, which is based on a second fingerprinting process. The first fingerprint and the second fingerprint are associated with the same data segment. Data operations such as a backup operation, a restore operation, or a replication operation can be performed while the conversion of the data segment from the second fingerprint to the first fingerprint is ongoing.

Fingerprint change during data operations

A computer-implemented method for improving the efficiency of recording data to tape may include (i) identifying a command to duplicate a data unit to tape storage after a previous version of the data unit has already been duplicated to tape storage, (ii) identifying metadata that distinguishes between segments of the data unit that have not changed since the previous version of the data unit and segments that have changed, (iii) reading the previous version of the data unit from tape storage and reading the segments of the data unit that have changed from a data sharing storage rather than tape storage, and (iv) combining, using the metadata, the segments read from tape storage that have not changed and the segments read from the data sharing storage that have changed to duplicate the data unit to tape storage. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for improving the efficiency of recording data to tape

A computer-implemented method for taking snapshots in a deduplicated virtual file system may include (1) maintaining a deduplicated virtual file system that stores, at an original location within a non-virtual file system, at least one configuration file storing metadata for a target file and an extent map for the target file, the extent map defining how to construct the target file from deduplicated data segments in a deduplicated storage system, (2) receiving a request to take a snapshot of the target file corresponding to the configuration file, (3) copying the configuration file storing metadata for the target file and the extent map for the target file into a snapshot location within the non-virtual file system, and (4) transmitting a file reference request to the deduplicated storage system to add a file reference within the deduplicated storage system. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for taking snapshots in a deduplicated virtual file system

A method for data container group management in a deduplication system is provided. The method includes arranging a plurality of data container groups according to a plurality of file systems. A subset of the plurality of data container groups correspond to each of the plurality of file systems, each of the plurality of data container groups having a reference database, a plurality of data containers, and a data container group identifier (ID). The method includes performing a first backup process for a first client-policy pair with deduplication via a first one of the plurality of data container groups and performing a second backup process for a second client-policy pair with deduplication via a second one of the plurality of data container groups.

Autonomous container group management for scale out deduplication system

A method to partition a deduplication pool is provided. The method includes determining that an amount of data in a plurality of data containers of the deduplication pool has reached a data capacity threshold and comparing each data container of the plurality of data containers with at least one other of the plurality of data containers as to amount of shared data. The method includes grouping, based on results of the comparing, the plurality of data containers into a plurality of groups of data containers, with data sharing from each of the plurality of groups of data containers to each other of the plurality of groups of data containers less than a data sharing threshold and data sharing inside each of the plurality of groups of data containers greater than the data sharing threshold.

Autonomous deduplication for efficient recovery for a deduplication system

A large-size circulating fluidized bed boiler, comprising: a furnace having a vertical furnace center line; and at least two groups of cyclones, each cyclone of each group of cyclones having an inlet gas pass communicated with the furnace. A furnace cross section formed by outer sidewalls and located at the inlet gas pass of the cyclone is a polygon having 2&#xd7;n sides, and n is a positive integer greater than 1. The polygon is axially symmetric with respect to a perpendicular bisector of each side of the polygon, and when n is 2, the polygon is a square. Triangles formed by two endpoints of an inlet of the inlet gas pass of each cyclone at the cross section and an intersection of the furnace center line and the cross section are congruent. A single flow field in communication with each of the inlet is formed in the cross section.

Large-scale circulating fluidized bed boiler

In some embodiments, a method of maintaining a reference list for data deduplication is provided. The method includes discarding a newly arriving data segment in response to finding a fingerprint of the newly arriving data segment matches an existing fingerprint in a plurality of fingerprints on a fingerprint-to-file reference list. The method includes adding, in the fingerprint-to-file reference list, to a list for the existing fingerprint, a source for the newly arriving data segment, in response to the fingerprint-to-file reference list indicating the existing fingerprint does not correspond to a hot data segment and setting an indication in the fingerprint-to-file reference list that the existing fingerprint corresponds to the hot data segment in response to the list for the existing fingerprint meeting or exceeding a predetermined number of entries. Other embodiments are included.

Handling data segments in deduplication

An efficient partitioning scheme is provided to improve efficiency of updating a reference list database of a deduplication engine. Transaction objects of a transaction log can be divided into a number of partitioned log files, based on criteria. The transaction objects within each partitioned log file are then sorted in parallel, while maintaining time order of the transaction objects. The present disclosure also provides for dividing database records of a reference list database into multiple tables, such as a master database table and a number of child database tables. The efficient partitioning scheme also provides for processing the transaction objects of each partitioned log file against a respective child table of the reference list database in parallel, such as by updating temporary child tables with information from the transaction objects in parallel. The temporary database tables then replace (the previous version of) the reference list database tables.

Scale up deduplication engine via efficient partitioning

A method for managing deduplication reference data may include (1) identifying multiple of data containers configured to store a plurality of deduplicated data segments that are referenced by multiple data objects within a deduplicated data system, (2) maintaining multiple reference databases including (i) a first reference database corresponding to a first subset of the data containers and (ii) a second reference database corresponding to a second subset of the data containers, the second subset differing from the first subset, (3) determining that a data object references at least one segment within a first data container within the first subset but does not reference any data segment within a second data container within the second subset and (4) updating the first reference database with information specifying that the data object references at least one data segment within at least one data container within the first subset of data containers.

Growing community of inventors

Beijing, China

Haigang Wang