Emc IP Holding Company LLC

Emc Corporation

Dell Products Inc.

Dan Aharoni

Amnon Naamad

Marik Marshak

Hagay Dagan

Gil Ratsaby

Arieh Don

Alexandr Veprinsky

Hui Wang

Owen Martin

Sean C Dolan

Itay Keller

Kenneth Goguen

Xiaoyan Wei

Adnan Sahin

Rong Yu

Stephen Richard Ives

Xiaomei Liu

Peng Yin

Sergey Rytenkov

Julio A Colon

Dimitar Petkov Gueorguiev

David Meiri

Alex Veprinsky

Yechiel Yochai

Qun Fan

Orit Levin-Michael

Ahmet Kirac

Pei-Ching Hwang

John W Lefferts

Drew P Tonnesen

Igal Moshkovich

Sanjay Narahari

Ilies Idrissi

Ophir Aharoni

Assaf Natanzon

Douglas Eric LeCrone

Peng Wu

Brett A Quinn

Doron Tal

Sudhir Srinivasan

Sachin More

Yaron Dar

Michael E Specht

Aharon Blitzer

Jeffrey Wilson

Gary H Cox

Robert DeCrescenzo

Ningdong Li

Edward S Robins

Kevin Granlund

Shoham Levy

Maureen Lally

Igor Patlashenko

Roi Tagar

Christopher Trudel

Ron Stern

Stephen F Modica

Richard F Otte

Anthony Cinelli

Dustin H Zentz

Almog Tabak

Christopher G LeClair

Pablo Srabstein

Mingjie Zhou

Rui Ding

Manickavasasaham M Senghuden

Marvin F Miller

Iliès Idrissi

John A Adams

Taojun Wu

Philipp Smirnov

Cyber-attacks on data maintained by a storage node are detected by monitoring for suspicious IOs to storage objects that contain only stable data. Data may be inherently stable or become stable based on elapsed time since the most recent update. Suspicious IOs to stable data storage objects include WR IOs that update stable data and, potentially, large-scale RD IOs. Metadata associated with storage objects is scanned to identify stable data storage objects and monitor for suspicious IOs. Further, stable data storage objects can be created by separating stable data from dynamic data, e.g., moving old data to a storage object that contains only old data. Exceptions are made for WR IOs that update metadata when processing small-scale RDs.

Detecting malicious activity based on accesses to stable data storage objects

A method in an illustrative embodiment comprises collecting performance measurement data for processing of input-output operations sent by a host to a storage system for a first period of time prior to a configuration change and a second period of time subsequent to the configuration change, processing performance measurement data for the first period of time to determine a first point in a plane defined by a first performance metric and a second performance metric, processing performance measurement data for the second period of time to determine a second point in the plane defined by the first and second performance metrics, determining one or more characteristics of a positioning of the second point relative to the first point, and controlling execution of at least one automated action relating to at least one of the host and the storage system based at least in part on the one or more characteristics.

Automated determination of performance impacts responsive to system reconfiguration

Methods, apparatus, and processor-readable storage media for implementing host-controlled service levels are provided herein. An example computer-implemented method includes obtaining, at a storage node of a storage system, information comprising one or more identifiers and one or more service levels that are assigned to virtual machines identified by the one or more identifiers; extracting one of the one or more identifiers from an input-output operation received at the storage node; identifying, based on the extracted identifier, the service level that is assigned to the virtual machine that initiated the input-output operation; and controlling storage resources allocated for one or more additional input-output operations from one or more of the virtual machines based at least in part on the identified service level.

Configuring storage resources based on service levels

A migration management application may facilitate generating an image of a source cloud block drive formatted according to a first format. The management application may facilitate copying of the image to a target cloud block drive formatted according to a second format. Changes directed to the source drive during copying of the image may be stored to a first journal, which may be copied to the target drive. During copying of the first journal, changes directed to the source drive may be stored to one or more subsequent journals. Upon determining that a subsequent journal is smaller than a configured cutover criterion, the management application may pause, during a cutover period, directing of changes to the source drive. The management application may copy changes, directed to the source drive during the cutover period, to the target drive and may redirect user/data applications to operate with respect to the target drive.

Migrating data between heterogeneous cloud block devices

Techniques are provided for processing of input/output (I/O) operations within a fault domain of a data storage system. One method comprises receiving I/O write requests from a client application, executing in a first fault domain, to write data; writing, by the storage control system, a primary copy of the data of the I/O write requests to at least one storage volume in the first fault domain using a designated assignment of the client application to the first fault domain; and writing a secondary copy of the data of the I/O write requests to at least one storage volume in an additional fault domain, wherein data responsive to I/O read requests from the client application executing in the first fault domain is obtained from the at least one storage volume in the first fault domain.

Processing of input/output operations within a fault domain of a data storage system

Methods and systems for managing storage of data are disclosed. To manage data storage, one or more access management frameworks may be used. One of the access management frameworks may be a storage array side framework that limits access to data based on user reservations. The user reservations may indicate the data subject to access limitation, the entity that requested the user reservation, and the extent of the access limitation. The user reservations may be used by the storage array to process receive input-output.

System and method for managing use of storage in distributed systems

Techniques are provided to manage data on shutdown of a data storage system. For example, a method comprises initiating a process to shut down a data storage system which comprises storage devices that store data associated with one or more non-persistent logical storage resources of a virtual storage layer which is configured by the data storage system. In response to initiating the process to shut down the data storage system, the method comprises: storing configuration data associated with the virtual storage layer, the configuration data comprising unique identifiers associated with the one or more non-persistent logical storage resources; and performing a data backup process to persistently store a copy of the data associated with the one or more non-persistent logical storage resources to a backup storage system.

Managing data on shutdown of storage system

Techniques are provided for selective powering of storage drive components in a storage node based on system performance limits. One method comprises determining a number of storage drive components, of multiple storage drive components in a storage node, needed to support at least one workload of the storage node, wherein the determining is based at least in part on a number of storage drive components needed to support a system performance limit determined using a component performance limit of at least one other component of the storage node, wherein the component performance limit is based at least in part on one or more of an expected number of input/output operations of the storage node and an expected bandwidth of the storage node; and initiating an application of power to the determined number of storage drive components of the storage node.

Selective powering of storage drive components in a storage node based on system performance limits

A storage control system is configured to obtain first data associated with a logical data device and to store the first data in a first entry of a log-structured array. The storage control system is further configured to invalidate a second entry of the log-structured array based at least in part on the storage of the first data in the first entry. The second entry comprises second data that was associated with the logical data device prior to obtaining the first data. The storage control system is further configured to determine that a first indication in a first metadata indicates that the invalidated second entry corresponds to a transaction log and to defer reclamation of the second entry based at least in part on the determination that the first indication in the first metadata indicates that the invalidated second entry corresponds to the transaction log.

Deferred reclamation of invalidated entries that are associated with a transaction log in a log-structured array

An apparatus comprises at least one processing device comprising a processor coupled to memory. The at least one processing device is configured to obtain an input-output request issued by an application executing on a compute node via at least one network and to identify a storage node as corresponding to the obtained input-output request based at least in part on the obtained input-output request. The at least one processing device is configured to associate information corresponding to the compute node with the input-output request and to submit the input-output request and the associated information that corresponds to the compute node to the storage node via the at least one network. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Direct response to IO request in storage system having an intermediary target apparatus

In some embodiments, a storage system comprises at least one processor coupled to memory. The processor is configured to obtain a write operation that comprises first data associated with a logical data device and to store the first data in a first entry of a log-structured array (LSA). The at least one processor is configured to invalidate a second entry based at least in part on the storage of the first data in the first entry. The second entry comprises second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation. The at least one processor is configured to determine that a first indication in LSA metadata associated with the LSA indicates that the invalidated second entry comprises data that is awaiting replication and to defer reclamation of the second entry based at least in part on the determination.

Deferred reclamation of invalidated entries associated with replication in a log-structured array

An apparatus comprising a processing device is configured to communicate with a storage node of a storage system via at least one network and to communicate with a compute node that implements at least a portion of an application via the at least one network. The at least one processing device is configured to obtain an input-output request associated with the application from the compute node via the at least one network and to associate information corresponding to the compute node with the input-output request. The at least one processing device is further configured to submit the input-output request and the associated information that corresponds to the compute node to the storage node. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Direct response to IO request in storage system with remote replication

A processing platform is configured to communicate over a network with one or more client devices, and to receive a request from a given one of the client devices for a proposed configuration of a storage system. The processing platform identifies based at least in part on the received request at least one processor to be utilized in implementing the storage system, selects a particular one of a plurality of storage system performance models based at least in part on the identified processor, computes a performance metric for the storage system utilizing the selected storage system performance model and one or more characteristics of the identified processor, generates presentation output comprising: (i) the performance metric, and (ii) information characterizing at least a portion of the proposed configuration of the storage system, and delivers the presentation output to the given client device over the network.

Processing platform configured to estimate storage system performance utilizing processor characteristics

Techniques and mechanisms for establishing and implementing performance objectives for an application based at least in part on a workload type of the application. A system includes a storage system on which an application imposes a workload by utilizing storage resources of the storage system, and a performance level has been associated with the application. A workload type is associated with the application based on the type of workload, and a performance objective is determined for the application based on the performance level and the workload type of the application. The storage resources are manipulated to achieve the performance objective.

Application-specific workload-based I/O performance management

A method includes (a) receiving workload data for a data storage system, the data storage system having a plurality of processing cores, the data storage system being configured to operate according to any of a plurality of profiles, each of the plurality of profiles having a respective assignment of respective cores of the plurality of cores to particular storage roles of the data storage system, (b) for each profile of the plurality of profiles, simulating operation of the data storage system running a workload based on the received workload data using the assignment of respective cores of the plurality of cores to particular storage roles for that profile, thereby producing a set of utilization scores, (c) selecting a profile of the plurality of profiles based on the set of utilization scores, and (d) outputting an indication of the selected profile for use by the data storage system.

Intelligent core assignment

Growing community of inventors

Brookline, MA, United States of America

Dan Aharoni