Emc IP Holding Company LLC

Emc Corporation

Dell Products Inc.

Alan Lee Taylor

Nagapraveen Veeravenkata Seela

Michael C Brundage

Karl M Owen

David Haase

Miles Aram De Forest

Nagasimha G Haravu

Paul Thomas McGrath

Michael Paul Wagner

Michael D Haynes

Robert F Goudreau

Chung-Huy Chen

Dayanand Suldhal

James Mark Holt

William Paul Hotle

Girish Sheelvant

David W Harvey

Dennis Thomas Duprey

Michael Lee Burriss

Somnath A Gulve

Philippe Armangau

William C Davenport

Dmitry Nikolayevich Tylik

Vasudevan Subramanian

Charles Christopher Bailey

Vasu Subramanian

Jason L Taylor

Arun Joseph

William S Burney

Anitta Jose

John H Lee

David Meiri

Xiangping Chen

Peter John McCann

Steven A Morley

Aharon Blitzer

Yuval Harduf

Timothy C Ng

Xunce Zhou

William C Whitney

Marina Shem Tov

Milind M Koli

Miles Aram DeForest

Samuel Mullis

Saurabh M Pathak

Anil Kumar Koluguri

David Bernard

Sathya Krishna Murthy

Amihay Azruel

Carole Ann Gelotti

Peter E Tolvanen

Dave W Harvey

Jeffrey Lucovsky

H Austin Spang, Iv

Michael Hamel

Somchai Pitchayanonnetr

Dean A Herington

Mayank Ajmera

Michael J Noeth

Kenneth John Hayman

Samuel Lee Mullis, Ii

David J Maddison

Varun K Chinta

Joseph S Ash

C Christopher Bailey

Anita I Bezera

Tarek Haidar

Alexander Izikson

Christopher Adam Norris

Ensuring snapshot consistency in a Kubernetes platform is presented. For instance an example method can comprise in response to receiving a management operation from a data analytics engine user interface, determining that the management operation is an executable operation that manipulates a first data resource of a group of data resources and a second data resource of the group of data resources, based on the management operation being the executable operation, generating a custom resource representing an operation in progress custom resource, in response to executing the operation in progress custom resource, manipulating the first data resource and the second data resource by facilitating execution of the management operation; determining that the management operation has completed manipulating the first data resource and the second data resource, and in response to determining that the management operation has completed execution, deleting the custom resource.

Snapshot consistency in a kubernetes platform

Techniques for optimizing a remote data copy using multiple storage nodes. The techniques include receiving a copy command for a volume at a first node, a first subset of VOL slices being owned by the first node, and a second subset of VOL slices being owned by a second node. The techniques include obtaining, by the first node, respective diff bitmaps for the first subset of slices and the second subset of slices. The techniques include sending the diff bitmap for the second subset of slices to the second node. The techniques include performing, by the first node, a first copy operation based on the diff bitmap for the first subset of slices, and performing, by the second node, a second copy operation based on the diff bitmap for the second subset of slices, the second copy operation being performed at least partially in parallel with the first copy operation.

Method for optimizing a remote data copy using multiple nodes

Selective replication of data in a data storage system includes tracking write transactions using tracking entries in a tracking structure. The tracking structure is periodically processed to create a reporting structure containing reporting entries each identifying a respective extent modified by one or more of the write transactions. The processing for each tracking entry includes (1) examining the reporting structure to determine whether the tracking entry expands an extent of a reporting entry, (2) based on the tracking entry not expanding an extent a reporting entry, creating a new reporting entry based on the tracking entry, and (3) based on the tracking entry expanding an extent of a reporting entry, modifying the reporting entry to identify the extent as so expanded. The reporting structure is used to perform a replication copy operation of the extents identified therein.

Data storage system with efficient data change reporting for replication

In at least one embodiment, processing can include: receiving a request to create identical snapshots of volumes V1 and V2 configured as a stretched volume; and in response to receiving the request, performing first processing including: holding write acknowledgements for the stretched volume; tracking writes to the stretched volume; creating a first snapshot of V1 on a first system and a second snapshot of V2 on a second system; stopping tracking of writes to the stretched volume; resuming write acknowledgements for the stretched volume; determining tracked writes for the stretched volume; determining a set of locations corresponding to the tracked writes; selecting the first snapshot of V1 as a master copy; determining data changes corresponding the set of locations from the master copy; replicating the data changes from the first system to the second system including the second system; and applying the data changes to the second snapshot of V2.

Techniques for creating identical snapshots of replicated volumes

Techniques for providing host applications the ability to dynamically manage application-specific functionality of storage applications. The techniques include providing, on a storage system, a storage application such as a data object processing pipeline including a series of pipeline elements (PEs), and receiving, at the storage system from a host computer, a command containing parameters for configuring an application of a specified PE from among the series of PEs. The techniques further include, in response to receipt of the command, configuring, by the storage system, the application of the specified PE based on the parameters contained in the command, executing the data object processing pipeline including the application of the specified PE on end-user data, and sending, by the storage system to the host computer, a command containing verification information pertaining to execution of the data object processing pipeline and/or information pertaining to processing or memory resources of the storage system.

Provide host applications ability to dynamically manage application specific functionality on storage application

Techniques are disclosed for storage resource resynchronization using pending IO requests. For example, a method includes, upon detecting a failed network: quiescing IO activity in progress; identifying storage resources and associated pending IO requests; for each storage resource: creating a first snapshot of the storage resource; for each pending IO request, marking blocks specified by the pending IO request as modified; unquiescing the quiesced IO activity; upon detecting the network has been restored: creating a second snapshot of each storage resource; remote mirroring, to the destination, a copy of differences of each source storage resource to the destination storage resource, wherein the differences are identified by comparing the first and the second snapshot; transmitting a request for the destination to create a third snapshot comprising a snapshot of each destination storage resource; and triggering the destination to process the third snapshot to identify storage resources based on the differences.

Storage resource resynchronization using pending IO requests

Techniques can include: performing asynchronous replication for a source storage object and a target storage object; tracking writes tagged with a tracking identifier associated with a replication related snapshot of the source storage object; receiving a request at a source system to create identical user snapshots of the source storage object and the target storage object; creating a user snapshot of the source storage object; and storing a record in metadata of tracked writes denoting a time order of the request relative to tracked writes tagged with the tracking identifier; determining, in accordance with said tracking, first tracked writes tagged with the tracking identifier that are received before the request; replicating, to the target system, data changes from the replication related snapshot corresponding to the first tracked writes; and creating a user snapshot of the target storage object after data changes are applied to the target storage object.

Techniques for user snapshot orchestration during asynchronous replication

Techniques for supporting a native pipeline element abstract for use in processing and storing data objects in a storage environment. The techniques include providing a data object processing pipeline for execution on a storage system, ingesting, by the data object processing pipeline, data objects collected by a plurality of computerized devices coupled to the storage system, performing queuing and processing of the data objects at a series of processing elements of the data object processing pipeline, and providing the processed data objects from the storage system to a host computer for subsequent use or analysis. In this way, the number of storage requests needed to be handled by the storage system can be reduced. Moreover, because the data object processing pipeline can be implemented and executed on the storage system, the processing and storage of data objects in the storage environment can be performed more efficiently and optimized more easily.

Native pipeline element abstract support in storage system

Techniques can include: receiving from a component a bufferless read request to read data of a storage object; opening a first transaction; acquiring locks of data pages including the read data; locking cache pages; storing the read data in the cache pages; sending to the component a notification identifying references, pointers or addresses of the cache pages storing the read data; responsive to receiving the notification, the first component performing one or more operations including directly accessing the first data from the cache pages using the references, pointers or addresses; and responsive to successfully completing the one or more operations, performing second processing including: releasing or unlocking the set of one or more cache pages storing the first data; releasing the one or more locks of the one or more data pages including the first data; and closing the first transaction.

Replication techniques with data copy avoidance

Techniques for resynchronizing storage resources of two sites configured for synchronous replication can include tracking in-progress write requests in a map. Responsive to a site failure or a replication link failure resulting in failure or fracture of the synchronous replication, processing can be performed to resynchronize impacted resources of the two sites configured for synchronous replication. The processing can use the in-progress write requests in combination with resource snapshots and snapshot differences to resynchronize the impacted resource of the two sites. In at least one embodiment, the synchronous replication configuration can include active paths between both sites and a host. In at least one embodiment, the synchronous replication configuration can include an active path between the host and one site, and a passive path between the host and the second site. The synchronous replication can be bi-directional or two-way synchronous replication between the two sites.

Techniques for optimized data resynchronization between replication sites

A method performed by a data storage apparatus of maintaining filesystem object attributes in connection with a plurality of drivers is provided. Each driver of the plurality is configured to operate on a respective set of filesystem objects. The method includes (a) for each driver of the plurality, creating a respective driver-specific storage volume; (b) storing, within each driver-specific storage volume, attributes specific to respective filesystem objects operated on by the driver of that driver-specific storage volume; and (c) while operating a particular driver of the plurality on a particular filesystem object, using values of the stored attributes specific to that particular filesystem object operated on by that particular driver. An apparatus, system, and computer program product for performing a similar method are also provided.

Per-service storage of attributes

Techniques for creating identical snapshots can include: performing synchronous replication between a first storage object of a first system and a second storage object of a second system; enabling change tracking for the first storage object that records in a log which portions of the first storage object are written or modified; responsive to enabling change tracking, creating a snapshot Sof the second storage object of the second system; responsive to creating the snapshot Sof the second storage object; creating a snapshot Sof the first storage object of the first system; responsive to creating the snapshot Sof the first storage object, disabling change tracking for the first storage object; and copying written or modified content of the first storage object as identified in the log to the snapshot Sof the second storage object of the second system.

Techniques for creating identical snapshots on systems during synchronous replication

Techniques for creating and using snapshots may include: receiving a request to create a new snapshot of a source object; determining whether a first generation identifier associated with the source object matches a second generation identifier associated with a base snapshot of the source object; determining whether the source object has been modified since the base snapshot was created; and responsive to determining the first generation identifier matches the second generation identifier and also determining that the source object has not been modified since the base snapshot was created, associating the new snapshot with the base snapshot thereby indicating that the new snapshot and the base snapshot have matching content and denote a same point in time copy of the source object.

Snapshot performance optimizations

Data storage management may include configuring a stretched volume in a metro cluster configuration using a first volume and a second volume both configured as a same logical volume, L; receiving I/O operations at the metro cluster configuration directed to L, wherein the I/O operations include a write operations that are received at a first system of the metro cluster configuration and that write first data to the first volume; viewing values of a metric regarding data replication performed for the first volume to replicate data between systems of the metro cluster configuration for writes directed to the first volume; responsive to said viewing, determining whether the first metric values denote a problem has occurred in the metro cluster configuration at a first point in time; and responsive to determining that the problem has occurred at the first point in time, performing one or more corrective actions.

Data storage system management techniques and metrics

A technique for maintaining synchronization between two arrays includes assigning one array to be a preferred array and the other array to be a non-preferred array. When write requests are received at the preferred array, the writes are applied locally first and then applied remotely. However, when write requests are received at the non-preferred array, such writes are applied remotely first and then applied locally. Thus, writes are applied first on the preferred array and then on the non-preferred array, regardless of whether the writes are initially received at the preferred array or the non-preferred array.

Write first to winner in a metro cluster

Growing community of inventors

Cary, NC, United States of America

Alan Lee Taylor