Netapp, Inc.

Jonathan Curley

Srishylam Simharajan

Vijay Mohan Deshmukh

Kiyoshi James Komatsu

Xin Wang

Gurmeet Singh

Laura Beegle

Richard Jernigan

Devang Kundanlal Shah

Richard Parvin Jernigan, Iv

Ram Kesavan

Subramaniam Periyagaram

Keith Allen Bare, Ii

A method, non-transitory computer readable medium, and device that replicates data and provides instantaneous access to data includes receiving in a destination volume one or more named data extents and one or more references to the one or more named data extents associated with a file in parallel from a source volume. A determination is made to check whether the one or more references arrive before the one or more named data extents arrive. Each of the received one or more references which are determined to have arrived prior to the one or more data extents is allocated as absent by the storage management computing device. An instantaneous access to the file is provided during the allocation.

Methods for replicating data and enabling instantaneous access to data and devices thereof

The disclosed techniques enable push-based piggybacking of a source-driven logical replication system. Logical replication of a data set (e.g., a snapshot) from a source node to a destination node can be achieved from a source-driven system while preserving the effects of storage efficiency operations (deduplication) applied at the source node. However, if missing data extents are detected at the destination, the destination has an extent pulling problem as the destination may not have knowledge of the physical layout on the source-side and/or mechanisms for requesting extents. The techniques overcome the extent pulling problem in a source-driven replication system by introducing specific protocols for obtaining missing extents within an existing replication environment by piggybacking data pushes from the source.

Push-based piggyback system for source-driven logical replication in a storage environment

Technology is disclosed for a data migration process for a storage server that preserves storage efficiency information. The storage server receives an indication of a group of two or more files and selects among the two or more files a reference file and one or more selected files. The storage server initiates a first migration operation to copy or move the reference file from a source storage server to a destination storage server. The storage server initiates one or more additional migration operations to copy or move the selected files from the source storage server to the destination storage server. At least one of the additional migration operations include a step of transmitting to the destination storage server data blocks of the selected files that are not shared between the reference file and the selected files, but avoid transmitting to the destination storage server the blocks shared with the reference file.

Data migration preserving storage efficiency

A system and method for data replication is described. A destination storage system receives a message from a source storage system as part of a replication process. The message includes an identity of a first file, information about where the first file is stored in the source storage system, a name of a first data being used by the first file and stored at a first location of the source storage system, and a fingerprint of the first data. The destination storage system determines that a mapping database is unavailable or inaccurate, and accesses a fingerprint database using the fingerprint of the first data received with the message to determine whether data stored in the destination storage system has a fingerprint identical to the fingerprint of the first data.

Data transfer between storage systems using data fingerprints

A method, non-transitory computer readable medium and programmed apparatus that receives a request to replicate a volume from a source to a destination. The volume includes data and metadata including information descriptive of the data. The method includes determining a first set of blocks and a second set of blocks associated with the source, where the first set of blocks is associated with the metadata, and where the second set of blocks is associated with the data. The method includes initiating, based on the first set of blocks, replication of the volume from the source to the destination to generate a replicated volume at the destination. The replicated volume includes replicated metadata generated based on the replicated first set of blocks and includes absent allocated data corresponding to the data included in the volume storage at the source storage system.

Replication of volumes on demands using absent allocation

Systems and methods which provide an absent allocation technique with respect to absent data of a data structure for which data migration in a time-displaced data migration operation has not completed are disclosed. Through use of absent allocated data block states of an absent allocation technique of embodiments, dependency between source and destination data stores may be broken. An absent allocated data block state of embodiments stored within the data structure provides a suggestive indication that data of a data block of a data structure is absent from the data structure. A corresponding absent allocated data block state of embodiments stored external to the data structure provides a determinative indication that the data of the data block of the data structure is absent from the data structure. The absent data block determinative indictor of embodiments is updated as data continues to be migrated.

Growing community of inventors

Pittsburgh, PA, United States of America

Jonathan Curley