Quest Software Inc.

Dell Products Inc.

Brian Smith

Tarun Tripathy

Abhijit Dinkar

Rob Rodriquez

Shweta Shintre

Tom Ramsdell

Disclosed herein are systems, methods, and devices for testing deduplication repositories. Methods may include identifying a storage location based on a request for one or more data values associated with a read-only file system, where the read-only file system is a simulated file system, and where the storage location is identified based on a plurality of request parameters included in the request. The methods may also include generating, using a processor and responsive to the request, the one or more data values based on the plurality of request parameters and a plurality of configuration parameters, where the plurality of configuration parameters enable deterministic generation of all data values stored in the tile system. The methods may further include returning the one or more data values as a result of the request.

Read-only file system for testing de-duplication

Techniques and mechanisms described herein facilitate the transmission of a data stream from a client device to a networked storage system. According to various embodiments, a fingerprint for a data chunk may be identified by applying a hash function to the data chunk via a processor. The data chunk may be determined by parsing a data stream at the client device. A determination may be made as to whether the data chunk is stored in a chunk file repository at the client device. A block map update request message including information for updating a block map may be transmitted to a networked storage system via a network. The block map may identify a designated memory location at which the chunk is stored at the networked storage system.

Client-side deduplication with local chunk caching

Techniques and mechanisms described herein facilitate the transmission of a data stream to a networked storage system. According to various embodiments, a data stream may be parsed to identify one or more uncompressed data chunks for transmission to a networked storage system. Each uncompressed data chunk may be compressed to produce a respective compressed data chunk. Each compressed data chunk may be transmitted to the networked storage system via a network for storage at the networked storage system.

Chunk compression in a deduplication aware client environment

Techniques and mechanisms described herein facilitate the transmission of a data stream to a networked storage system. According to various embodiments, a determination may be made as to whether an amount of available computing resources at a client device meets or exceeds a computing resource availability threshold at the client device. A processing operation on a data stream may be performed at the client device to produce a pre-processed data stream when the amount of available computing resources meets or exceeds the computing resource availability threshold. The pre-processed data stream may be transmitted to a networked storage system for storage via a network. The networked storage system may be operable to store deduplicated data for retrieval via the network.

Technique selection in a deduplication aware client environment

Techniques and mechanisms described herein facilitate the acceleration of data transfer protocols via client side de-duplication techniques for transmitting data from a client device to a networked storage system while maintaining protocol usage characteristics. while preserving the same presentation semantics to the users. A data chunk may be determined at a client device by parsing a data stream generated at the client device via a network storage protocol. A fingerprint for the data chunk may be identified by applying a hash function to the data chunk. A determination may be made as to whether the chunk is stored at a networked storage system by transmitting the fingerprint to the networked storage system via a network. The client device may transmit a block map update request message including information for updating a block map to the networked storage system.

Accelerating transfer protocols

Mechanisms are provided to allow for application transparent deduplication data. A mail database associated with a mail application can be analyzed to identify attachments meeting particular administrator criteria. The attachments are analyzed and replaced with stubs to allow continued mail application interaction with the mail database. The attachments may be optimized with deduplication and/or compression.

Application transparent deduplication data

Mechanisms are provided to maintain deduplication data in native file formats. Files, including entities such as volumes and databases, are analyzed to identify components suitable for deduplication. These components suitable for deduplication are delineated into chunks and identifiers are generated for each of the chunks. The identifiers are used to reference the chunks in deduplication dictionaries that provide locations indicating where deduplicated chunks are stored. The components in the files are replaced with file handles or stubs that applications can use to access deduplicated data. Applications can continue to perform operations on the files as though no deduplication has occurred.

Growing community of inventors

San Ramon, CA, United States of America

Brian Smith