Emc IP Holding Company LLC

Dell Products Inc.

Anurag Bhatnagar

Michael Anthony

Shanmuga Anand Gunasekaran

Rabi Shankar Shaw

Sarat Kumar Behera

Mark Aldred

Priyamrita Ghosh

Deepak Vokaliga

Jean-Pierre Bono

Upanshu Singhal

Sudhir Srinivasan

Frederic Corniquet

David M King

Prakash Venkatanarayanan

Shane Sullivan

Mithun Mahendra Varma

Akash Gosain

Rahul Kumar Pathak

Akshay Jagirdar

Joyanto Biswas

Parimal Patil

Meenakshi Rani

Methods, system, and non-transitory processor-readable storage medium for a policy proposal system are provided herein. An example method includes applying at least one policy to data stored on a storage system to identify matched data, where the matched data is data to be moved from the storage system to a secondary storage system. The policy proposal system identifies unmatched data stored on the storage system, where the unmatched data is data that is not identified as the data to be moved from the storage system to the secondary storage system. The policy proposal system trains a machine learning system with the matched data and the unmatched data. The policy proposal system predicts at least one new policy, where application of at least one new policy identifies at least a subset of the unmatched data to be moved from the storage system to the secondary storage system.

Intelligent policy module

A method comprises requesting and receiving from a cloud mobility platform metadata for accessing one or more file systems which have been tiered to cloud storage, and writing the metadata to at least one backup storage location. In the method, a plurality of stub files are read, the plurality of stub files corresponding to a plurality of files of the one or more file systems which have been tiered to cloud storage. The plurality of stub files are written to the at least one backup storage location.

Data protection for stub files and cloud metadata

A method comprises receiving an input specifying one or more rules for archiving a plurality of files from a source storage location to a target storage location, wherein the target storage location comprises a cloud storage platform comprising a plurality of storage classes. In the method, one or more of the plurality of files are retrieved from the source storage location for migration to the target storage location based at least in part on the one or more rules. Assignment of the one or more of the plurality of files to respective ones of the plurality of storage classes is controlled based at least in part on the one or more rules. The one or more rules specify one or more constraints for the assignment of the one or more of the plurality of the files to the respective ones of the plurality of storage classes.

File tiering to different storage classes of a cloud storage provider

A method comprises computing a hash value for at least one file of a plurality of files in connection with a file tiering operation of the plurality of files from a source storage location to a target storage location. The hash value is compared to one or more hash values corresponding to one or more other files of the plurality of files. Based at least in part on the comparing, a determination is made whether the hash value is the same as any of the one or more hash values. The at least one file is identified as a duplicate file in response to an affirmative determination. The target storage location comprises a cloud storage platform.

Deduplication for cloud storage operations

A method comprises receiving an input specifying one or more rules in connection with archiving one or more of a plurality of files from a source storage location to a target storage location. The one or more rules specify one or more constraints for retention of the one or more of the plurality of the files. In the method, the one or more of the plurality of files are retrieved from the source storage location for migration to the target storage location. A request is sent to the target storage location that the target storage location invoke the one or more rules to retain the one or more of the plurality of files in the target storage location. The target storage location comprises a cloud storage platform.

Policy based stub file and cloud object retention

Methods, apparatus, and processor-readable storage media for efficient synchronization of a cloud enabled file system database during a snapshot restore operation are provided herein. An example computer-implemented method includes intercepting a user request to initiate a snapshot restore operation on a file system associated with a local storage system, wherein the file system comprises one or more stub files that are indicative of locations of cloud objects comprising files that were previously sent from the local storage system to a cloud storage platform; prior to the snapshot restore operation being performed, creating a current snapshot of the file system; obtaining an indication that the file system was successfully restored on the local storage system; and using the current snapshot to perform a synchronization operation, wherein the synchronization operation deletes one or more orphan cloud objects in the cloud storage platform that resulted from the snapshot restore operation.

Efficient synchronization of cloud enabled file system database during snapshot restore operation

An apparatus comprises a processing device configured to identify a snapshot lineage comprising snapshots of a given storage volume, the snapshot lineage comprising (i) a local snapshot lineage stored on a storage system and (ii) a cloud snapshot lineage stored on cloud storage of at least one cloud external to the storage system, the cloud snapshot lineage comprising at least a subset of the snapshots of the given storage volume. The processing device is also configured to determine whether the local snapshot lineage is associated with any current local storage volume of the storage system corresponding to the given storage volume and, responsive to determining that the storage system is not associated with any current local storage volume corresponding to the given storage volume, to select a snapshot from the cloud snapshot lineage and recover the selected snapshot to a new local storage volume on the storage system.

Recovering a storage volume associated with a snapshot lineage from cloud storage

A method comprises storing information corresponding to a plurality of files being written from a source storage device to a cloud storage platform in a file transfer operation. The method further comprises, in response to a failure of the file transfer operation, identifying from the information one or more file offsets successfully written to the cloud storage platform for one or more of the plurality of the files prior to the failure. The file transfer operation for the one or more of the plurality of files is resumed from the identified one or more file offsets.

Resume support for cloud storage operations

An apparatus includes a processing device configured to identify a snapshot policy for creating a snapshot lineage comprising snapshots of a storage volume comprising data stored on a storage system, the snapshot lineage comprising (i) a local snapshot lineage stored on the storage system and (ii) at least one cloud snapshot lineage stored on cloud storage. The processing device is also configured to generate snapshots of the storage volume in accordance with the snapshot policy, to store the snapshots in the local snapshot lineage, and to copy snapshots from the local snapshot lineage to the at least one cloud snapshot lineage in accordance with the at least one snapshot policy. The processing device is further configured to provide an interface for managing the snapshot lineage by accessing, from the storage system, snapshots of the storage volume in the local snapshot lineage and the at least one cloud snapshot lineage.

Managing snapshots stored locally in a storage system and in cloud storage utilizing policy-based snapshot lineages

A method comprises receiving a request to restore a given snapshot of a plurality of snapshots from a cloud storage platform to a storage array. In the method, a first metadata file corresponding to the given snapshot is downloaded from the cloud storage platform, and data corresponding to the given snapshot is written to the storage array. An additional metadata file corresponding to a previous snapshot of the plurality of snapshots with respect to the given snapshot is downloaded. The first metadata file and the additional metadata file are compared to determine whether one or more offsets in the additional metadata file are present in the first metadata file. Data corresponding to any of the one or more offsets determined to be absent from the first metadata file is written to the storage array, and the one or more absent offsets are added to the first metadata file.

Restoration of snapshots from cloud using differential snapshot mechanism

Methods, apparatus, and processor-readable storage media for deleting orphan archived files from a storage array using a time-based decision algorithm are provided herein. An example computer-implemented method includes traversing a database of a local storage system to identify a record associated with a stub file, wherein the record is indicative of a time of a client operation, involving the stub file, on a file system of the local storage system; identifying a particular snapshot in a set of available snapshots of the file system; and providing an indication to a cloud storage platform to delete a cloud object corresponding to the stub file in response to determining that the time of the client operation occurred earlier than a snapshot time associated with the particular snapshot in the set.

Deleting orphan archived files from storage array using a time-based decision algorithm

A processing device is configured to communicate over a network with a storage system comprising a plurality of storage devices. The device comprises a multi-path input-output (MPIO) driver configured to control delivery of input-output (IO) operations from the device to the storage system over selected ones of a plurality of paths through the network. The paths are associated with respective initiator-target pairs, and each of a plurality of targets of the initiator-target pairs comprises a corresponding port of the storage system. The MPIO driver is further configured to create a plurality of IO operation threads, to use a given IO operation thread to retrieve a given IO operation from an IO queue, to attempt to perform the given IO operation on a given target of the plurality of targets, and to return the given IO operation to the IO queue upon a failure to perform the given IO operation.

Snapshot transmission from storage array to cloud using multi-path input-output

An apparatus comprises a processing device configured to identify a snapshot lineage comprising (i) a local snapshot lineage stored on a storage system and (ii) a cloud snapshot lineage stored on cloud storage of a cloud external to the storage system. The processing device is also configured to select, in accordance with a snapshot policy, a snapshot in the local snapshot lineage to copy to the cloud snapshot lineage. The processing device is further configured to create a virtual device on the storage system, to link the selected snapshot to the virtual device, to determine data of the selected snapshot that is to be copied from the virtual device to a cloud storage volume on the cloud storage, and to copy the selected snapshot to the cloud snapshot lineage by copying the determined data from the virtual device to the cloud storage volume.

Moving snapshots from a local snapshot lineage on a storage system to a cloud snapshot lineage on cloud storage

A method comprises selecting at least a given stub file of one or more stub files for migration from a source storage location to a target storage location. The selection of the given stub file is based at least in part on a database entry comprising source storage location path information for the given stub file. The one or more stub files correspond to one or more archived files, and the one or more stub files and one or more non-stub files are stored in the source storage location. In the method, the given stub file is migrated to the target storage location without migrating the one or more non-stub files to the target storage location. The method further includes modifying the database entry by replacing the storage location path information with target storage location path information for the given stub file.

Stub file selection and migration

An apparatus comprises a processing device configured to detect a request to resume copying of a snapshot of a storage volume from a storage system to cloud storage, to determine an original snapshot differential for the snapshot comprising differential data of the storage volume on the storage system, and to obtain checkpointing information for the snapshot characterizing a status of copying portions of the snapshot to the cloud storage. The processing device is also configured to generate a resume snapshot differential for the snapshot comprising portions of the snapshot to be copied to the cloud storage determined based at least in part on a comparison of the original snapshot differential with the checkpointing information characterizing the status of copying the one or more portions of the snapshot to the cloud storage. The processing device is further configured to resume copying of the snapshot utilizing the resume snapshot differential.

Growing community of inventors

Bengaluru, India

Anurag Bhatnagar