International Business Machines Corporation

Emc IP Holding Company LLC

Dell Products Inc.

Globalfoundries Inc.

Sap Ag

Globalfoundries U.S. 2 LLC

Rivka Mayraz Matosevich

Zah Barzik

Lior Chen

Orit Nissan-Messing

Daniel Isaac Goodman

Shachar Fienblit

Gail Andrea Spear

Michael Keller

Ran Harel

Ifat Nuriel

Sheli Rahav

Dalit Tzafrir

Osnat Shasha

Michael Edward Factor

Doron Tal

Amiram Hayardeny

Amit Margalit

Eliyahu Weissbrem

Maxim Kalaev

Sivan Tal

Ziv Dor

Yossi Siles

Theresa Mary Brown

William Frank Micka

Yosef Shatsky

Thomas Charles Jarvis

Amalia Avraham

Svetlana Shukevich

Nikolas Ioannou

Jonathan Amit

Ioannis Koltsidas

Alon Marx

Oren S Li-On

Ovad Somech

Roman Spiegelman

Amichai Schreiber

Dan Ben-Yaacov

Lokesh M Gupta

Michael T Benhase

Matthew Sanchez

Carol Santich Mellgren

Mark J Halstead

Adnan Sahin

Warren Keith Stanley

Eitan D Farchi

David Lionel Black

Robert Francis Bartfai

Sam Clark Werner

Ohad Atia

Eyal Perek

Alexander Snast

Dan Cohen

Eran Tzabari

Eli Koren

Anna Stopel

Ram Elron

Tomer Goldberg

Michael Green

Mor Griv

Vladimir Zaslavski

Itzhack Goldberg

Sanjib Mallick

Walter A O'Brien, Iii

Constantine Gavrilov

Sergey Marenkov

Ofer Leneman

Amit Pundalik Anchi

Ehood Garmiza

Nadav Parag

Yaacov Frank

Itay Keller

Asaf Porat-Stoler

Jonathan Fischer-Toubol

Deborah A Messing

Christopher M Dennett

Afief Halumi

Shay Berman

Barak Pinhas

Lior Zilpa

Tal Abir

Prakash Venkatanarayanan

Michael E Specht

Roi Tagar

Evgeny Katz

Yair Elharrar

Yuval Peleg Lieblich

Gil Ben Zeev

German Goft

Ori Ben-Itzhak

Irit Cohen

Amir Aloosh

Eyal Brami

Yakov Gerlovin

Kobi Beifus

Tamar Shacked

Demian Glait

Yuval Ben-Horin

An apparatus in an illustrative embodiment comprises at least one processing device that includes a processor coupled to a memory. The at least one processing device is configured to associate a logical storage volume with at least one path between a host and at least a given one of a plurality of storage nodes of a distributed storage system, and to associate a proxy volume with respective sets of one or more paths from the host to each of the plurality of storage nodes of the distributed storage system. The at least one processing device is further configured to obtain an input-output operation directed to the logical storage volume, and to redirect the input-output operation to the proxy volume over a selected one of the paths associated with the proxy volume. Such an arrangement can avoid one or more host-side restrictions, thereby enhancing scalability of the distributed storage system.

Host multi-path layer with proxy volume redirection for enhanced scalability of distributed storage systems

Techniques are provided for storage system interface discovery with a limited number of persistent host discovery connections. One method comprises receiving, by a receiving storage system interface of multiple storage system interfaces, a discovery connection request from a given host interface; transforming, by the receiving storage system interface, an identifier of a host device associated with the given host interface to obtain an identifier of a given storage system interface; determining, by the receiving storage system interface, whether the identifier of the given storage system interface identifies the receiving storage system interface; and in response to the identifier of the given storage system interface identifying the receiving storage system interface, the receiving storage system interface (i) provides a persistent discovery connection to the given host interface; and (ii) provides discovery information to the given host interface identifying a set of available storage system interfaces.

Storage system interface discovery with limited number of persistent host discovery connections

A method is disclosed of copy-free, non-disruptive conversion of a storage volume from a first access protocol to a distinct second access protocol. In a preparatory step a destination volume accessible according to the second access protocol is created. A pairing of a token and a handle is created, the token representing data content of the source volume, the handle being associated with the token and usable to represent the source volume according to the second protocol. In response to a subsequent copy-with-handle command, and based on the pairing of the handle with the token, metadata of the destination volume is populated to reference, without copying, the underlying stored data, the destination volume thereafter functioning as the storage volume accessed using the second protocol.

Data volume access protocol conversion without data copy

A first storage system receives a request to migrate a volume from the first storage system to a second storage system, and commences a migration process to non-disruptively migrate the volume from the first storage system to the second storage system while the volume is being accessed by a host system. The first storage system sends a first request to the host system to discover information for connecting to the second storage system to allow the host system to access to the volume through the second storage system during the migration process. In addition, the first storage system sends a second request to the host system to discover information for disconnecting from the first storage system during a final stage of the migration process.

Managing host connectivity during non-disruptive migration in a storage system

An apparatus includes at least one processing device configured to identify a logical storage volume stored across multiple storage nodes of a distributed storage system, to obtain address range distribution information for the logical storage volume from at least a subset of the storage nodes, the address range distribution information indicating, for each of a plurality of distinct address ranges of the logical storage volume, which of the storage nodes locally stores data for that address range, and to generate, from the obtained address range distribution information, a mapping of the distinct address ranges to particular ones of the storage nodes, wherein the mapping is utilized to select paths for delivery of input-output operations to the storage nodes. Obtaining address range distribution information for the logical storage volume may comprise, for example, sending log page commands to each of the storage nodes to obtain asymmetric range access and/or template information.

Host path selection utilizing address range distribution obtained from storage nodes for distributed logical volume

Techniques are provided for load balancing in a storage system using a storage system-driven host connectivity management process. For example, a load balancing process comprises monitoring a distribution of input/output (I/O) workload across resources of a storage system to detect for an occurrence of an I/O workload imbalance, generating updated connection information for a host system connected to the storage system, in response to detecting the occurrence of an I/O workload imbalance, and sending a request to the host system to discover the updated connection information for connecting to the storage system based on the updated connection information.

Load balancing using storage system driven host connectivity management

Techniques are provided for managing quality of service (QoS) policies in a virtual storage environment. A data storage system receives a request from a host system to connect to a target virtual volume in a storage array of the data storage system, and determines a protocol endpoint which has an assigned QoS policy which corresponds to a QoS policy of the target virtual volume. The data storage system binds the target virtual volume to the protocol endpoint which is determined to have an assigned QoS policy which corresponds to the QoS policy of the target virtual volume, and sends a unique identifier of the protocol endpoint, which is bound to the target virtual volume, to the host system. The data storage system utilizes the protocol endpoint, which is bound to the target virtual volume, to handle data access requests received from the host system for accessing the target virtual volume.

Enforcing quality of service in a virtualized storage environment

Techniques are provided for managing replication journals in a distributed replication system. A data replication system assigns an associated replication journal volume to each replication component operating on a storage node. Each replication component is configured to handle a portion of a replication workload which is distributed among the replication components, and to write journal data in the associated replication journal volume of the replication component. The data replication system performs a recovery process in response to detecting a failed replication component. The recovery process includes designating at least one replication component as a recovery replication component, designating the associated replication journal volume of the failed replication component as a recovery journal volume, and assigning the recovery journal volume to the recovery replication component to enable the recovery replication component to recover journal data in the recovery journal volume.

Managing replication journal in a distributed replication system

A system for managing storage of data in composed information handling systems includes a system control processor manager that identifies a compute resource set having compute resources specified by a composition request, identifies a hardware resource set having hardware resources specified by the composition request including a local data processor that services writes using a local device and a remote device, sets up storage management services for managing writes of data to the hardware resource set using a control resource set and the compute resource set to obtain logical hardware in which the local data processor preferentially services writes of the data using the local device rather than the remote device, and presents the logical hardware resources using the control resource set to the compute resource set as bare metal resources to instantiate a composed information handling system to service the composition request.

Method and system for efficient servicing of storage access requests

A processing device obtains a write operation which comprises first data and second data to be stored in first and second strips of a given stripe. The processing device stores the first data in the first strip and determines that the second strip is unavailable. The processing device determines a parity based on the first data and the second data and stores the parity in a parity strip. The processing device updates metadata to indicate that the second data was not stored in the second strip. In some embodiments, the updated metadata is non-persistent and the processing device may be further configured to rebuild the given stripe, update persistent metadata corresponding to a sector of stripes including the given stripe and clear the non-persistent metadata based at least in part on a completion of the rebuild.

Storage system having RAID stripe metadata

Techniques are provided for managing host connectivity to a data storage system. A host connectivity management system receives a request from a host system to connect to a data storage system. The data storage system includes storage nodes which include storage volumes, and each storage node includes multiple ports to enable connection to the storage node. The host connectivity management system determines a subset of ports, among all available ports of the storage nodes, to assign to the host system for use by the host system for connecting to the storage nodes of the data storage system to access the storage volumes. The host connectivity management system sends connection information to the host system to enable the host system to connect to the data storage system, wherein the connection information includes port identifiers associated with the subset of ports assigned to the host system.

Managing host connectivity to a data storage system

Techniques are provided for generating host connectivity plans with load balancing and resiliency. One method comprises obtaining a number of storage system target ports needed for a given host; identifying available target ports in the storage system and an input-output (IO) target component associated with each available target port; and calculating the host connectivity plan until the host connectivity plan includes the obtained number of target ports by: (i) selecting at least one IO target component not already in the host connectivity plan that satisfies a resiliency policy and/or a load balancing policy; (ii) selecting at least one target port associated with the selected at least one IO target component and (iii) adding the selected at least one target port to the host connectivity plan. The resiliency policy may require connectivity without a single point of failure. The load balancing policy may specify that the IO target components serve a substantially equal IO load.

Generation of host connectivity plans with load balancing and resiliency

Techniques are provided for managing system upgrades in a network computing environment. For example, a method includes managing an upgrade of a system within a cluster of systems which communicate in a network computing environment system to implement a distributed application. The system performs an upgrade operation to upgrade a current version of the system to a new software version number which comprises a new feature. The system performs a cluster version update process to communicate with other systems in the cluster to determine a cluster version number of the cluster. The system enables the new feature of the new software version if the new software version number is not greater than the determined cluster version number of the cluster.

Managing system upgrades in a network computing environment

An apparatus comprises a processing device configured to receive a request to create a given storage volume in a storage system, the storage system providing a plurality of storage features. The processing device is also configured to select, for the given storage volume, one of a set of one or more volume tiers, each of the volume tiers specifying whether respective ones of the plurality of storage features provided by the storage system are enabled or disabled for storage volumes associated with that volume tier. The processing device is further configured to create the given storage volume in the storage system, and to associate the selected volume tier with the given storage volume, wherein associating the selected volume tier with the given storage volume comprises enabling or disabling respective ones of the plurality of storage features provided by the storage system as specified by the selected volume tier.

Volume tiering in storage systems

A method and system may reconstruct data in a smart storage array where upon detection of data inconsistency, an application of the system is notified and affected data strips are rebuilt. When an initiator detects stripe corruption, the initiator may report the strip corruption to storage. The storage may lock the strip for I/O operations. Initiators may determine recovery scenarios for rebuilding the data strips and send the scenarios to storage. At storage, initiator replies may be collected, and a rebuild option with the highest votes may be automatically determined for a reconstruction operation. Once the reconstruction operation is completed, the rebuilt stripe may be unlocked and data operations may recommence.

Reconstructing data in a smart storage array

Growing community of inventors

Zichron Ya'acov, Israel

Rivka Mayraz Matosevich