International Business Machines Corporation

Pillar Data Systems, Inc.

Noel Simen Otterness

David Alan Burton

Joseph G Skazinski

Brian Dennis McKean

Alan Lee Stewart

Edward Lewis Hauck

William A Brant

Kurt Alan Shoens

Wayne Eugene Miller

Yuri Vladimirovich Bagashev

Paul Michael Remley

Mohamad H El-Batal

Michael Edward Nielson

Thomas E Richardson

Walter A Hubis

Joseph Paul Hughes

Keith Edward Short

Bruce A Woller

An apparatus for managing incremental storage includes a storage pool management module that allocates storage volumes to a virtual volume. Also included is an incremental log corresponding to the virtual volume, which maps virtual addresses to storage addresses. The apparatus may also include a replication module that sends replicated data to the virtual volume and a policy management module that determines allocation criteria for the storage pool management module. In one embodiment, the incremental log includes a lookup table that translates read and write requests to physical addresses on storage volumes within the virtual volume. The replicated data may include incremental snapshot data corresponding to one or more primary volumes. The various embodiments of the virtual incremental storage apparatus, method, and system facilitate dynamic adjustment of the storage capacity of the virtual volume to accommodate changing amounts of storage utilization.

Virtual incremental storage apparatus method and system

The present invention relates to systems and methods of asynchronous data replication. In an embodiment, the system includes a primary host that asynchronously transmits write and sync commands where each write and sync command includes a data set ID and a sequence number. A secondary host coupled to the primary host receives the write and sync commands out of order, tracks receipt of write and sync commands, and after receipt of the write and sync commands of the data set writes blocks associated with the write commands to data storage coupled to the secondary host.

Systems and methods of asynchronous data replication

A message tracker having a transfer monitor, a set of registers, and at least one arithmetic unit increases performance and reliability when transmitting or receiving messages within a computer system. A set of message parameters such as a current address, a remaining length, and a communicated length are stored within the set of registers. The transfer monitor observes data transfers on a multi-tenant bus in order to detect data transfers related to the message and provide an update signal. The message parameters within the registers are updated in response to the update signal. The process of detecting and updating is repeated until the entire message is transferred, and the message tracker then informs a control processor or process that communication of the message has occurred. To facilitate message coalescing, several message trackers may share a message queue that is configured to store message parameters corresponding to completed messages.

Message tracking method, apparatus, and system

The invention relates to methods of snapshot operation for a data storage system with a host communicating with a cache memory, a source Virtual Logical Unit Number (VLUN) and a target VLUN, including generating first metadata (e.g., bitmaps and log files pointers) to locate first snapshot data and to indicate when the first snapshot data is in the target VLUN and generating second metadata to locate second snapshot data and to indicate when the second snapshot data is in the target VLUN, wherein the first and second metadata locate the same data in the target VLUN. The invention relates to systems that implement the methods. It relates to destaging data to maintain data consistency including reading metadata for snapshots, searching the metadata to identify snapshots that require original data to be destaged, destaging the original data to target storage, and updating metadata to locate original data and indicate destage completion.

Systems and methods of data migration in snapshot operations

Snapshot sets comprising snapshot criteria are created, maintained, and executed via a command set designed to facilitate managing and conducting snapshots on data distributed across multiple volumes. Snapshot criteria such as source volume, target volume, redundancy level, copy mode, and the like are added as desired to a snapshot set. Upon invocation of an execute command, the fast replication operations defined by the snapshot set are executed, providing a logically atomic data replication utility potentially involving multiple sources and targets. In one embodiment auto selection of a target may be specified, thus facilitating over-subscription of target resources. The present invention reduces the complexity of archiving data&#x2014;particularly data distributed across multiple volumes such as data associated with database applications and the like.

Snapshot management method apparatus and system

A method for managing incremental storage includes a storage pool management module that allocates storage volumes to a virtual volume. Also included is an incremental log corresponding to the virtual volume, which maps virtual addresses to storage addresses. The method may also include a replication module that sends replicated data to the virtual volume and a policy management module that determines allocation criteria for the storage pool management module. In one embodiment, the incremental log includes a look up table that translates read and write requests to physical addresses on storage volumes within the virtual volume. The replicated data may include incremental snapshot data corresponding to one or more primary volumes. The various embodiments of the virtual incremental storage method facilitate dynamic adjustment of the storage capacity of the virtual volume to accommodate changing amounts of storage utilization.

Virtual incremental storage method

The invention relates to management of I/O in data storage systems. In an embodiment, the invention provides a data storage subsystem processing I/O requests each having a priority, comprising a processor, a memory coupled to the processor, a disk array, an array controller coupled to the processor and the disk array, a network interface, coupled to the processor, to receive an I/O request with a priority, and a program in the memory for managing the I/O request based on the priority, a clip level of the priority, the total workload in the data storage subsystem, and processing I/O requests based on priority, workload clip levels, and fairness levels. The invention also contemplates the use of static and dynamic adjusted clip levels. The invention also relates to a method of managing I/O requests, comprising receiving an I/O request, determining the priority of the I/O request, comparing the total workload to the clip level for the priority, and processing the I/O request if the total workload is below the clip level or the priority workload is below a fairness level.

Methods and systems of managing I/O operations in data storage systems

A method, apparatus and program storage device for allowing continuous availability of data during volume set failures in a mirrored environment. Continuous servicing of input/output request for a volume set having failed on a primary array using either portions of the failed volume set or a mirrored volume set is provided. A determination is made whether the failed volume set can service the input/output request and continuous data availability is provided by using the failed volume set to process the input/output request when the failed volume set can service the input/output request, else using a remote mirrored volume set to process the input/output request.

Method, apparatus and program storage device for allowing continuous availability of data during volume set failures in a mirrored environment

An apparatus, method, and system for speculative data mirroring include a rollback log that receives write data corresponding to a write operation that is directed to a storage region within a source volume. Also included is a storage control module that initiates a lock operation on a corresponding storage region within a target volume and a mirror control module configured to send the data corresponding to the write operation to the target volume without waiting for feedback regarding the lock operation. In one embodiment, initiating a lock operation may include sending a lock command to the target volume. Alternatively, the data corresponding to the write operation may initiate the lock operation. In addition, the mirror control module may initiate retransmission of the data in response to subsequent execution of the lock operation. Due to the unique configuration of the present invention, the present invention reduces latencies arising from synchronous mirroring operations, such as lock operations.

Speculative data mirroring apparatus method and system

Management of I/O operations in data storage systems

A process, apparatus, and system stores data check information on an electronic storage medium that uses standard sector data field sizes. The check information may include a cyclic redundancy check (CRC), a logical block address (LBA), a longitudinal redundancy check (LRC), state information, a sequence number, or other information to identify data state, misplacement, or corruption. The check information, instead of being appended to the data within the data sector, may be stored in an independent check sector. The check information corresponding to multiple data sectors may also be aggregated and stored in a single check sector. The process or apparatus may be incorporated in a storage system controller, a RAID controller, a software SCSI stack in a computer, an operating system, a storage device driver, or another appropriate application that interfaces with standard and commodity storage system components.

Process, apparatus, and system for storing data check information using standard sector data field sizes

An apparatus, system, and process are disclosed for maintaining data in an electronic storage array during multiple, concurrent drive failures. A first drive failure is recognized and the storage system controller subsequently enters a first operating mode. The storage system controller then recognizes a second drive failure and enters a second operating mode, which is different from the first operating mode, in response to the second drive failure. The second operating mode allows the storage system controller and a recovery module to access the data of the second failed drive in a controlled manner in order to attempt to recover the data on the first failed drive. Also, a pinned data module may allow write data to be written to a pinned data drive, instead of a failed drive, while the storage system controller is operating in the second operating mode.

Apparatus, system, and method for maintaining data in a storage array

The present invention relates to system and method of asynchronous data replication. In an embodiment, the system includes a primary host that asynchronously transmits write and sync commands where each write and sync command includes a data set ID and a sequence number. A secondary host coupled to the primary host receives the write and sync commands out of order, tracks receipt of write and sync commands, and after receipt of the write and sync commands of the data set writes blocks associated with the write commands to data storage coupled to the secondary host.

Data replication in data storage systems

The invention relates to snapshots of a data storage system including a host that communicates with a cache memory, source storage, target storage, and metadata, including a source storage for active data, a target storage to store migrated snapshot data, first metadata (e.g., bitmaps and log files with pointers) to indicate when and where the first snapshot data is in target storage, and second metadata (e.g., bitmaps and log files pointers) to indicate when and where the second snapshot data is in target storage where the first and second metadata locate the same snapshot data in the target storage. The invention maintains data consistency when reading metadata for snapshots into host memory, searching the metadata to identify snapshots that require original data to be destaged, destaging the original data to target storage, and updating the metadata to locate the original data and indicate completion of the target destage operation.

The present invention relates to a cache memory management system suitable for use with snapshot applications. The system includes a cache directory including a hash table, hash table elements, cache line descriptors, and cache line functional pointers, and a cache manager running a hashing function that converts a request for data from an application to an index to a first hash table pointer in the hash table. The first hash table pointer in turn points to a first hash table element in a linked list of hash table elements where one of the hash table elements of the linked list of hash table elements points to a first cache line descriptor in the cache directory and a cache memory including a plurality of cache lines, wherein the first cache line descriptor has a one-to-one association with a first cache line. The present invention also provides for a method converting a request for data to an input to a hashing function, addressing a hash table based on a first index output from the hashing function, searching the hash table elements pointed to by the first index for the requested data, determining the requested data is not in cache memory, and allocating a first hash table element and a first cache line descriptor that associates with a first cache line in the cache memory.

Growing community of inventors

Lafayette, CO, United States of America

Noel Simen Otterness