Emc IP Holding Company LLC

Dell Products Inc.

Kurumurthy Gokam

Kundan Kumar

Venkatesh Doddamane Nagaraj

Sanjib Mallick

Gopinath Marappan

Md Haris Iqbal

Mohammad Salim Akhtar

Shubham Sharma

Peniel Charles

Madhu Tarikere

Ashwin Ramkrishna Tidke

Prasad Vishnu Paple

Remesh Parakunnath

Arieh Don

Vinay G Rao

Govindaraja Nayaka B

Nihar R Panda

Prashant Kulli

Manu R Sareena

Shivasharan Srikanteshwara

An apparatus in one embodiment comprises a host device comprising a processor coupled to memory. The host device is configured to communicate over a network with at least one storage system. The host device is further configured to retrieve data corresponding to a plurality of processes for submitting a plurality of input-output operations to the at least one storage system, to identify one or more constraints on the plurality of processes based at least in part on the data; and to control submissions of the plurality of input-output operations to the at least one storage system based at least in part on the one or more constraints. The retrieval of the data, the identification of the one or more constraints and the control of the submissions are performed in a user space of the host device.

Management of input-output operations in user space

An apparatus comprises at least one processing device that includes a processor coupled to a memory. The at least one processing device is configured to implement a source multi-path device between a source access device and a source logical storage device, to implement a target multi-path device between a target access device and a target logical storage device, and to initiate a data migration process to migrate data from the source logical storage device to the target logical storage device. The at least one processing device is further configured, in conjunction with the data migration process, to copy a set of paths of the source multi-path device to the target multi-path device, and to at least temporarily provide to the source access device identifying information of the source logical storage device in place of identifying information of the source multi-path device.

Spoofing of device identifiers in non-disruptive data migration

An apparatus comprises a processing device that includes a processor coupled to a memory. The processing device is configured to identify a source multi-path device in first multi-pathing software, to create a target multi-path device in second multi-pathing software different than the first multi-pathing software, to copy a set of paths of the source multi-path device to the target multi-path device, to add to the set of paths of the source multi-path device a new path to the target multi-path device, and to remove paths other than the new path from the source multi-path device. Such an arrangement illustratively provides non-disruptive switching of path selection functionality of a host device from the source multi-path device of the first multi-pathing software to the target multi-path device of the second multi-pathing software. The source and target multi-path devices illustratively utilize different storage access protocols, such as respective SCSI and NVMe access protocols.

Non-disruptive switching of multi-pathing software

Techniques are provided for provisioning zoned storage devices to sequential workloads. One method comprises obtaining a sequentiality classification of at least one workload of an application associated with a storage system comprising a plurality of zoned storage devices; and provisioning at least one of the zoned storage devices for storing the data of the at least one workload in response to the at least one workload being classified as a sequential workload. A sequentiality classification of a workload (e.g., as a sequential workload or a random workload) can be determined by: (i) evaluating the application name and/or application type of an application, (ii) learning input-output workload patterns, such as sequential read/write operations or random read/write operations, and/or (iii) detecting the application access mode to persistent volumes, such as a sequential write access mode.

Provisioning zoned storage devices to sequential workloads

An apparatus comprises a processing device configured to identify a plurality of data portions from a source storage volume to be copied to a target storage volume, and to analyze performance of respective ones of a plurality of host devices in connection with at least one copying operation. Respective ones of the plurality of host devices are assigned to perform copying of respective subsets of the plurality of data portions to the target storage volume based, at least in part, on the analysis.

Load sharing of copy workloads in device clusters

An apparatus includes at least one processing device configured to obtain information characterizing which of a plurality of storage nodes of a distributed storage system stores respective ones of a plurality of different logical blocks of a logical storage volume of the distributed storage system. The at least one processing device is further configured, for each of a plurality of input-output operations directed to a particular one of the logical blocks of the logical storage volume, to identify, based at least in part on the obtained information, which of the plurality of storage nodes of the distributed storage system stores the particular logical block, to select a path to the identified storage node, and to send the input-output operation to the identified storage node over the selected path.

Intelligent path selection in a distributed storage system

Host computers running applications that store data on a block-based storage system such as a SAN provide hints that differentiate IO data based on which application generated the IO. The hints may include tags that are associated with IO commands sent to the block-based storage system. Each host application is associated with a unique identifier that is placed in the tag. Application name-to-identifier mappings may be sent from the hosts to the block-based storage system. Per-identifier/application deduplication statistics are maintained by the block-based storage system and shared with other block-based storage system. Deduplication is disabled or de-emphasized for IO data generated by applications with statistically low deduplication ratios.

Intelligent deduplication in storage system based on application IO tagging

A host device is configured to obtain a default timeout value of the host device for the submission of an input-output (IO) operation to a storage system and to determine a first timeout value that is less than the default timeout value. The host device is further configured to submit the IO operation to the storage system along a first path using the first timeout value and to determine that the submission of the IO operation along the first path has timed out. The host device is further configured to determine a second timeout value that is greater than the first timeout value and to submit the IO operation to the storage system along a second path using the second timeout value.

Fast multipath failover

A host device comprises a plurality of communication adapters and is configured to communicate with a storage system. Each communication adapter comprises a plurality of input-output (IO) submission queues each having a submission queue priority class. A multi-path input-output (MPIO) driver is configured to deliver IO operations to the storage system over the network. The MPIO driver obtains an IO operation that targets a given logical volume of the storage system and determines a process tag value associated with the obtained IO operation. A mapping between the determined process tag value and a given submission queue priority class is determined and IO submission queues are identified as having the given submission queue priority class based at least in part on the mapping. A target IO submission queue is selected from the identified IO submission queues and the IO operation is dispatched to the selected target IO submission queue.

Storage system with submission queue selection utilizing application and submission queue priority

An apparatus comprises a host device comprising a processor coupled to memory. The host device is configured to obtain a network congestion notification from a portion of a network that is utilized by the host device for submitting IO operations to a storage system. The network congestion notification comprises an indication that the portion of the network is experiencing network congestion. The host device is further configured to identify a first path of a plurality of paths as a path that utilizes the portion of the network and to adjust a dispatch weight of the first path based at least in part on the network congestion notification. The host device is further configured to submit an IO operation to the storage system along a second path instead of the first path based at least in part on the adjusted dispatch weight of the first path.

Congestion aware multipathing based on network congestion notifications

Techniques are provided for selective snapshot creation using source tagging of input-output (I/O) operations. One method comprises receiving an I/O operation; obtaining an I/O tag associated with the I/O operation indicating a source of the I/O operation (e.g., a source application or a source virtual machine); updating a cumulative I/O tag value associated with the I/O tag that indicates an amount of activity associated with the I/O tag; and initiating a snapshot of at least a portion of a storage system that stores data associated with the I/O operation in response to the cumulative I/O tag value satisfying a corresponding threshold value. A source device associated with the I/O operation may associate the I/O tag with the I/O operation and send the I/O operation with the I/O tag to the storage system.

Selective snapshot creation using source tagging of input-output operations

An apparatus comprises a host device configured to communicate over a network with a storage system. The host device comprises a plurality of communication adapters, each of which comprises a corresponding plurality of input-output (IO) submission queues, and a multi-path input-output (MPIO) driver configured to obtain an IO operation that targets a given logical volume of the storage system and to identify a plurality of paths between the host device and the given logical volume. Each identified path comprises a communication adapter and a corresponding IO submission queue of that communication adapter. An IO load weight and a queue depth weight are determined for each identified path. An adaptive weight for each identified path is determined as a function of the determined IO load weight and the determined queue depth weight for that identified path and a target path is selected from the identified paths based at least in part on the determined adaptive weights.

Adaptive load balancing in storage system having multiple input-output submission queues

An apparatus in one embodiment comprises a host device configured to communicate with a storage system. Responsive to an instruction to migrate data from a source volume to a destination volume, the host device replaces an input-output entry function of a source pathing device associated with the source volume with a migration input-output entry function that is configured, in response to receiving an input-output operation, to call an input-output entry function of a destination pathing device associated with the destination volume and to call the input-output entry function of the source pathing device. Responsive to an indication that a migration of data has completed, the host device replaces the migration input-output entry function with a post-migration input-output entry function. The post-migration input-output function is configured to call the input-output entry function of the destination pathing device in response to receiving an input-output operation.

Data migration agnostic of pathing software or underlying protocol

An apparatus in one embodiment comprises a host device that is configured to communicate over a network with at least one storage system comprising a source logical storage volume and a target logical storage volume. Responsive to a reboot of the host device during a migration of a plurality of chunks of data from the source logical storage volume to the target logical storage volume, the host device is configured to determine, based at least in part on an entry of a copy migration journal, the entry corresponding to a given chunk of the plurality of chunks, that the migration of the given chunk was in progress prior to the reboot. Responsive to determining that the migration of the given chunk was in progress prior to the reboot, the host device is configured to resume the migration of the plurality of chunks from the given chunk.

Migration resumption using journals

An apparatus comprises a host device comprising at least one processor coupled to memory. The host device is configured to communicate over a network with a storage system comprising a plurality of storage devices. The host device is further configured to identify a logical volume identifier corresponding to a given logical volume of the storage system and to submit a message comprising an indication of the logical volume identifier to a messaging system. The host device is further configured to obtain, from the messaging system, an indication of a pseudo name corresponding to the logical volume identifier and to assign the obtained pseudo name to a multipath device corresponding to the given logical volume, the multipath device comprising a plurality of paths between the host device and the given logical volume.

Growing community of inventors

Bengaluru, India

Kurumurthy Gokam