Emc Corporation

Other

Kenneth A Halligan

Erez Ofer

Arieh Don

John T Fitzgerald

Michael J Scharland

Patrick Brian Riordan

David Joshua Brown

Natan Vishlitzky

Alexandr Veprinsky

Hana Moreshet

Mathieu Gagne

Ishay Kedem

Aviram Cohen

Pei-Ching Hwang

Natan Vishlitsky

Described are techniques for allocating resources. Two consumer processes using two resources are provided. A first threshold of a first of the resources for a first of said two consumer processes is provided. A second threshold of a second of said resources for said first consumer process is provided. Consumption information is received regarding actual consumption of the two resources by the first consumer process. Execution of the first consumer process is scheduled in accordance with the first and the second thresholds and the consumption information.

Controlling resource allocation using thresholds and scheduling

Described is a distributed copying technique that may be used in migrating large amounts of data from one or more source devices to one or more destination devices. The data source is divided into partitions. As Fibre Channel adapters (FAs) become available, each of the FAs may copy a partition of the data. In connection with specifying paths used for the distributed copying technique, a preferred path selection (source port-target port mapping) may be made by executing code in a controlling data storage system to perform discovery processing. The preferred path selection is used for the duration of the distributed copying unless the preferred path is unable to transmit data. A target port of the preferred path may be randomly selected from all accessible target ports, and/or in accordance with a specified portion of the target ports. Preferred paths may also be specified using an API (application programming interface).

Path determination using preferred paths or randomly selecting source and target ports

Described are techniques for use with online data copying or migration. Data is pushed from a source to a target device while one or both of the source and target devices are available for use by one or more host systems. The host systems may perform I/O operations to the source and/or target devices while the data migration is ongoing if a copy session is defined on the data storage system(s) of the source and/or target devices. A copying operation performs data migration from the source to the target device. A migration vector is used to indicate which portions of the source have been migrated. A change vector may be associated with each of the source and/or target devices to indicate portions that have been modified in order to perform a differential copy operation.

Online data migration

Method for suspending a discovery process, saving the state of the discovery process, and resuming the discovery process during a distributed copy operation

Described are techniques for use with an error handling policy for a data storage system. Error handling criteria may be specified for controlling behavior of the data storage system upon the occurrence of an internal processing error occurring when performing an ancillary task associated with a data operation received by the data storage system. The error handling criteria may include a threshold counter value, and one or more of: a device, a specific device location or address, and a host. An error may be conditionally returned to the host upon the occurrence of an internal processing error in accordance with the error handling criteria.

Error handling policy

Two data operations, such as write operations, may be processed at a same time in which the two write operations operate on a same address range span. A first of the write operations may write to the first track and the last track in the span but not tracks therebetween. When processing the first write operation, a lock for the first track is obtained and the data is written to the first track data. A lock for the last track is obtained and it is determined whether all tracks between the first and last tracks are unlocked. If so, data is written to the last track. If not, steps of releasing and then reacquiring the lock for the last track and determining whether intervening tracks are locked are repeated until the intervening tracks are not locked. The last track is then written.

Techniques for performing data operations spanning more than two data partitions

Described is a distributed copying technique that may be used in migrating large amounts of data from one or more source devices to one or more destination devices. The data source is divided into partitions. As Fibre Channel adapters (FAs) become available, each of the FAs may copy a partition of the data. A copy indicator value indicates the last partition delegated to an FA for copying. The last FA to complete copying is responsible for ensuring completed copying of any other data partitions delegated to an FA which has died during migration of the other data partitions. In the event that the last FA dies prior to completing its processing, additional steps are performed by other remaining FAs to copy all data partitions not known to be successfully migrated.

Distributed workflow techniques

A method and apparatus for enabling an on-line reconfiguration of striped data in a disk array storage device. A replicated copy of the striped logical device is made in parallel with host operations. A logical device with a new configuration is then substituted for access by the host application even before any data is transferred to locations within the newly configured logical device. Independent processes operating in this disk array storage device reconfigure the data transparently to any host operations while accommodating host I/O requests directed to locations in the new configuration.

Method and apparatus for reconfiguring striped logical devices in a disk array storage

The invention relates to a method and apparatus for reordering, at a disk drive controller, a received sequence of read and write commands. The reordering can be system driven so that the system, when a command stalls, examines the command queue for another command to execute. Alternatively, the command queue itself can be reordered depending upon the expected time it takes for various commands to execute. Reordered commands can be flagged so that they cannot be reordered again. The resulting increase in throughput and efficiency occurs without reference to the particular disk drive or disk drive array configuration to which the controller is connected.

Command insertion and reordering at the same storage controller

A method and data storage system using the method, provides an efficiently approach for allocating a static amount of buffer space (e.g., records) among a number of logical volumes of a data storage system on the basis of the computing environment within which the data storage system is used. The method includes providing the data storage system from logical volumes, each including a command queue. Each command queue includes records, each for storing a command request. A memory pool is established from which one or more records can be allocated to each command queue associated with each logical volume. The memory pool has a predetermined number of records which can be allocated by the command queues of the logical volumes. Based on the computing environment, one of a number of allocation schemes for allocating records to a command queue is selected.

Method and system for allocating memory for a command queue

A method and apparatus for providing very large logical volumes (Meta Device) in a storage system is provided. The storage system includes host controllers and disk controllers which communicate through a shared memory. I/O requests are received by the host controller and placed into request queues. The request queues are associated with logical devices. A number of request queues in the host controller are concatenated together to produce the larger logical volume. The large logical volume appears to the host as a single addressable logical unit. I/O requests to the large logical volume are analyzed by the host controller to determine which logical devices are actually needed to service the request. The host controller then makes the appropriate queue entries. Processing of the requests then occurs in the same fashion as if the request had been to a non-Meta Device. This allows the disk controllers and memory to operate without modification.

Method and apparatus for providing logical devices spanning several physical volumes

A method of dynamically reconfiguring the logical devices in a storage system is provided. The method allows a logical devices to be added, removed, or repositioned without requiring the storage system to be taken off-line. The method includes manipulating the request queues associated with host controllers within the storage system. The request queues associated with each logical device may be repositioned in the request queue memory in order to make room for new logical devices or to take advantage of free space associated with a removed logical device. The storage system communicates with the host computer in order to manage the reconfiguration of the request queues while still providing storage services to the host computer.

Growing community of inventors

Leominster, MA, United States of America

Kenneth A Halligan