Emc IP Holding Company LLC

Emc Corporation

Scott H Ogata

Scott Auchmoody

Salil Dangi

Ernest Daza

James Zarbock

Jennifer Starling

Vladimir Mandic

Orit Levin-Michael

Kiran Bachu

Eric Olsen

Kedar Shrikrishna Patwardhan

Jedidiah Yueh

Thomas B Bolt

Qun Fan

Vijay C Madhavapeddi

Emile Snyder

Michael Smolenski

Dieter Rothmeier

Scott Dolim

Clint L McVey

William Crosby

Robert Ramos

Greg H Moulton

Data stream generation using prime numbers is disclosed, including: receiving an initialization parameter; and using the initialization parameter to generate a data stream comprising a merging of a first sequence and a second sequence, wherein the first sequence is generated using a first prime number and the initialization parameter and the second sequence is generated using a second prime number and the initialization parameter.

Data stream generation using prime numbers

Generating a data stream with a predictable change rate is disclosed, including: receiving a change rate parameter; and using the change rate parameter to provide a modified data stream that differs from a corresponding unmodified non-deduplicatable data stream by an amount determined based at least in part on the change rate parameter, including by: modifying at least a portion of a plurality of data blocks associated with the non-deduplicatable data stream to obtain a corresponding portion of the modified data stream, wherein a data block of the plurality of data blocks is associated with a block size that is based on a segmenting attribute associated with a storage destination.

Generating a data stream with a predictable change rate

A method, article of manufacture, system and apparatus for reducing data transfer and backup duration using a client side dataset paging cache. Backups may be associated with given datasets. Loading the same dataset previous backups pages and champions into memory will improve backups performance.

Dataset paging cache for storage system

Protected data is divided into a plurality of segments. For each segment in the plurality of segments, a fingerprint is generated. The plurality of fingerprints is grouped into group(s) of fingerprints and for each group of fingerprints, a group fingerprint is generated. It is determined if the group fingerprint being processed is stored in a cache and if so, the group fingerprint being processed is flagged as one for which a virtual copy will be performed.

Client side cache for deduplication backup systems

Generating non-compressible data streams is disclosed, including: receiving an initialization parameter; determining a constrained prime number, wherein the constrained prime number comprises a plurality of component values, wherein each of the plurality of component values comprises a prime number, wherein each of the plurality of component values is different; and generating a non-compressible sequence based at least in part on the initialization parameter and the constrained prime number.

Generating a large, non-compressible data stream

One example method is directed to generating a data sampling parameter, and includes identifying an incremental billing rate for data storage, where the data storage includes a data set having a multiple data pieces that each correspond with a respective unique indicator, and the unique indicators reside in a space. The example method further includes identifying a threshold billing increment, and determining an acceptable error in the threshold billing increment. Finally, the method includes determining a sub sample ratio based upon the threshold billing increment and the acceptable error. The sub sample ratio has a variable value 'X' which indicates that sampling of one unique indicator in every 'X' unique indicators in the space is sufficient to determine the size of the entire data set.

Backend capacity evaluation for deduplicated storage systems

A cloud storage system stores data objects from different customers. Each customer has their own encryption key to encrypt the data objects for storage and the key is not shared. To deduplicate the data objects, a set of base fingerprints associated with a set of base data objects is stored. A first fingerprint associated with a data object from a customer is compared with a base fingerprint. The first and base fingerprints are generated by applying an identical fingerprinting algorithm to unencrypted versions of the data objects. If the fingerprints match, the first fingerprint is associated with a base data object corresponding to the matching base fingerprint, and the data object from the customer is not stored. If the fingerprints do not match, the data object from the customer is stored.

System and method for a cloud storage provider to safely deduplicate encrypted backup objects

In one example method, a hash space is identified that includes hashes that each point to a respective piece of data in the customer data set. A first hash is selected using a sub sample ratio, and the first hash is checked to determine if the first hash points to data previously observed in an associated backup stream. If the first hash points to data not previously observed in the associated backup stream, the number of data pieces to which the first hash points are recorded, and if the first hash points to data previously observed in the associated backup stream, a second hash is selected using the sub sample ratio. The method can be repeated until the entire hash space has been sampled. The required storage capacity is calculated using the sub sample ratio and a sum of the recorded number of data pieces.

Backend capacity requirements for deduplicated storage systems

The present disclosure discusses systems and methods for replicating backups between deduplicated storage devices. Differences between related backups may be identified, and only those differences may be transferred. This may minimize data transfer and optimize resource consumption.

Optimizing replication of similar backup datasets

A method, article of manufacture, apparatus, and system for a paging cache is disclosed. The backup cache may be broken into pages, and a subset of these pages may be memory resident. The pages may be sequentially loaded into memory to improve cache performance.

Paging cache for storage system

Parent backup application driving of children backup applications is described. An instruction for a child backup application to execute a child backup task is communicated from a parent backup application to the child backup application. An instruction for a second child backup application to execute a second child backup task may be communicated from the parent backup application to the second child backup application. An execution of the child backup task by the child backup application is communicated from the child backup application to a parent backup application. An execution of the second child backup task by the second child backup application may be communicated from the second child backup application to the parent backup application. A parent backup task is executed by the parent backup application. At least one child backup application inherently lacks a functionality to execute the parent backup task as the parent backup application executes the parent backup task.

Method and system for parent backup application driving of children backup applications

Views of files in an archival data storage system are generated by a backup view generator. A storage application generates and stores archival data in an archive system, the archival data corresponding to client data stored on a server or in memory associated with one or more client nodes. The storage application also generates backup files of the archival data which may be stored in a local memory. A set of metadata attributes are associated with each of the backup files. The backup views are generated by comparing metadata values in a view definition file to the sets of attributes associated with the backup files. Generated backup views can be exported for processing, including searching the backup views or displaying the backup views in a user interface.

Growing community of inventors

Lake Forest, CA, United States of America

Scott H Ogata