Emc Corporation

Bruno Alterescu

Natan Vishlitzky

Moshe Yanai

Daniel Castel

Gadi G Shklarsky

Yuval Ofek

Daniel D C Castel

Yoav Raz

Daniel D Castel

Yuval Y Ofek

Two data storage systems are interconnected by a data link for remote mirroring of data. Each volume of data is configured as local, primary in a remotely mirrored volume pair, or secondary in a remotely mirrored volume pair. Normally, a host computer directly accesses either a local or a primary volume, and data written to a primary volume is automatically sent over the link to a corresponding secondary volume. Each remotely mirrored volume pair can operate in a selected synchronization mode including synchronous, semi-synchronous, adaptive copy-remote write pending, and adaptive copy-disk. Direct write access to a secondary volume is denied if a 'sync required' attribute is set for the volume and the volume is not synchronized.

Remote data mirroring

A primary data storage system is linked to a geographically remote secondary data storage system for automatically maintaining a remote copy of the data in the primary storage. The primary data storage system has a primary cache memory, and the secondary data storage system has a secondary cache memory. The primary data storage system controller has a first remote link adapter coupled between the primary cache memory and the communications link for transferring the data to the communications link. The secondary data storage system controller has a second remote link adapter coupled between the communications link and the secondary cache memory for transferring the data from the communications link to the secondary cache memory. In this fashion, the first remote link adapter and the second remote link adapter automatically transfer the data to the secondary cache memory for writing of the data into the secondary data storage.

Remote data mirroring system having a remote link adapter

Two data storage systems are interconnected by a data link for remote mirroring of data. Each volume of data is configured as local, primary in a remotely mirrored volume pair, or secondary in a remotely mirrored volume pair. Normally, a host computer directly accesses either a local or a primary volume, and data written to a primary volume is automatically sent over the link to a corresponding secondary volume. Each remotely mirrored volume pair can operate in a selected synchronization mode including synchronous, semi-synchronous, adaptive copy&#x2014;remote write pending, and adaptive copy&#x2014;disk. Direct write access to a secondary volume is denied if a 'sync required' attribute is set for the volume and the volume is not synchronized.

A primary data storage system is linked to a geographically remote secondary data storage system for automatically maintaining a remote copy of the data in the primary storage. The primary data storage system controller uses write pending indicators to control and coordinate the remote copy process. In response to receipt of data from the host computer, a first write pending indicator is set to write the data into at least one primary data storage device, and a second write pending indicator is set to copy the data to the secondary data storage system controller. The first write pending indicator is reset after the data is written to the primary data storage device, and the second write pending indicator is reset after receiving an acknowledgement back from the secondary data storage system controller.

Remote data mirroring system using local and remote write pending indicators

A primary data storage system is linked to a geographically remote secondary data storage system for automatically maintaining a remote copy of the data in the primary storage. Each of the data storage systems has at least one data storage device, a cache memory, a data storage system controller, and a service processor for servicing the data storage system. The primary and secondary service processors are linked to permit remote system configuration and remote software programming of the secondary data storage system, and to exchange a report of all the non-valid, out of sync tracks. The service processors can also perform the task of scanning for remote write pending bits to invoke the remote copy task, and checking for invalid track bits to invoke a task for copying data from a known good storage device to the device with the invalid track bit set.

Remote data mirroring system having a service processor

A data storage system includes data storage and a record locator data structure in random access memory. The record locator data structure includes entries having different lengths. For locating variable-length data records in the data storage, for example, at least some but not all of the entries have a data-length portion indicating data length of a respective data record of the entry when the data length of the respective data record fails to match an expected data length. Each entry, for example, has a fixed length portion including an indication of whether or not the entry has a data-length portion, the fixed length portions are stored sequentially in a first region of address locations of the random access memory, and the data-length portions are stored sequentially in a second region of address locations of the random access memory.

System and method for disk mapping and data retrieval

Two data storage systems are interconnected by a data link for remote mirroring of data. Each volume of data is configured as local, primary in a remotely mirrored volume pair, or secondary in a remotely mirrored volume pair. Normally, a host computer directly accesses either a local or a primary volume, and data written to a primary volume is automatically sent over the link to a corresponding secondary volume. Each remotely mirrored volume pair can operate in a selected synchronization mode including synchronous, semi-synchronous, adaptive copy-remote write pending, and adaptive copy-disk. Direct write access to a secondary volume is denied if a &ldquo;sync required&rdquo; attribute is set for the volume and the volume is not synchronized. If a &ldquo;volume domino&rdquo; mode is enabled for a remotely mirrored volume pair, access to a volume of the pair is denied when the other volume is inaccessible. In a &ldquo;links domino&rdquo; mode, access to all remotely mirrored volumes is denied when remote mirroring-is disrupted by an all-links failure. The domino modes can be used to initiate application-based recovery, for example, recovering a secondary data file using a secondary log file. In an active migration mode, host processing of a primary volume is concurrent with migration to a secondary volume. In an overwrite cache mode, remote write-pending data in cache can be overwritten. Write data for an entire host channel command word chain is bundled in one link transmission.

Asynchronous remote data mirroring system

An apparatus and method for disk mapping and data retrieval includes a data storage medium on which has been stored a plurality of data records. Each record includes at least a record identification portion, for uniquely identifying each record from among the plurality of data records. The apparatus builds a record locator table in high speed semiconductor memory which comprises the unique record identifiers for the records on the storage medium as well as a record locator index generated by the apparatus, which indicates the address of the data record on the storage medium. Data retrieval is facilitated by first searching the record locator table in high speed semiconductor memory for a requested data record. Utilizing the record locator index associated with the requested data record, the system directly H: accesses the requested data record on the storage medium thereby minimizing storage medium search time. Also disclosed is an apparatus and method for converting CKD formatted data records to FBA formatted disk drives and for building and compressing the &ldquo;count&rdquo; portion of the CKD data formatted record into a record locator table.

A method and apparatus for interfacing two ESCON compatible devices over a communication channel that is not dedicated solely to ESCON communication, such as a public communication network or links, for example, a T1 or T3 line. The devices may include a master storage device and a mirroring storage device disposed at remote locations. In one embodiment, the devices communicate using the ESCON protocol.

Method and apparatus for interfacing two remotely disposed devices coupled via a transmission medium

An apparatus and method for disk mapping and data retrieval includes a data storage medium on which has been stored a plurality of data records. Each record includes at least a record identification portion, for uniquely identifying each record from among the plurality of data records. The apparatus builds a record locator table in high speed semiconductor memory which comprises the unique record identifiers for the records on the storage medium as well as a record locator index generated by the apparatus, which indicates the address of the data record on the storage medium. Data retrieval is facilitated by first searching the record locator table in high speed semiconductor memory for a requested data record. Utilizing the record locator index associated with the requested data record, the system directly accesses the requested data record on the storage medium thereby minimizing storage medium search time. Also disclosed is an apparatus and method for converting CKD formatted data records to FBA formatted disk drives and for building and compressing the &ldquo;count&rdquo; portion of the CKD data formatted record into a record locator table.

A method of controlling distribution of processing in a system that includes a plurality of host data processors connected to a data storage system which includes a digital storage that is partitioned into a plurality of volumes. The method includes assigning ownership of the volumes to the host processors such that each of the host processors owns a different subset of the plurality of volumes, wherein a host processor is prohibited from sending I/O requests to any of the volumes which it does not own. The method further includes monitoring the I/O requests that are sent to each of the volumes by each of the host processors; from information obtained through monitoring, generating workload statistics indicative of the distribution of workload among the host processors; detecting a workload imbalance in the workload statistics; and in response to detecting a workload imbalance, reassigning ownership of the volumes to the host processors so as to change the distribution of workload among the host processors.

Dynamic load balancing

Two data storage systems are interconnected by a data link for remote mirroring of data. Each volume of data is configured as local, primary in a remotely mirrored volume pair, or secondary in a remotely mirrored volume pair. Normally, a host computer directly accesses either a local or a primary volume, and data written to a primary volume is automatically sent over the link to a corresponding secondary volume. Each remotely mirrored volume pair can operate in a selected synchronization mode including synchronous, semi-synchronous, adaptive copy-remote write pending, and adaptive copy-disk. Direct write access to a secondary volume is denied if a &ldquo;sync required&rdquo; attribute is set for the volume and the volume is not synchronized. If a &ldquo;volume domino&rdquo; mode is enabled for a remotely mirrored volume pair, access to a volume of the pair is denied when the other volume is inaccessible. In a &ldquo;links domino&rdquo; mode, access to all remotely mirrored volumes is denied when remote mirroring is disrupted by an all-links failure. The domino modes can be used to initiate application-based recovery, for example, recovering a secondary data file using a secondary log file. In an active migration mode, host processing of a primary volume is concurrent with migration to a secondary volume. In an overwrite cache mode, remote write-pending data in cache can be overwritten. Write data for an entire host channel command word chain is bundled in one link transmission.

A cache management system and method monitors and controls the contents of cache memory coupled to at least one host and at least one data storage device. A cache indexer maintains a current index of data elements which are stored in cache memory. A sequential data access indicator, responsive to the cache index and to a user selectable sequential data access threshold, determines that a sequential data access is in progress for a given process and provides an indication of the same. The system and method allocate a micro-cache memory to any process performing a sequential data access. In response to the indication of a sequential data access in progress and to a user selectable maximum number of data elements to be prefetched, a data retrieval requestor requests retrieval of up to the selected maximum number of data elements from a data storage device. A user selectable number of sequential data elements determines when previously used micro-cache memory locations will be overwritten. A method of dynamically monitoring and adjusting cache management parameters is also presented.

Cache memory with an allocable micro-cache

An apparatus and method for disk mapping and data retrieval includes a data storage medium on which has been stored a plurality of data records. Each record includes at least a record identification portion, for uniquely identifying each record from among the plurality of data records. The apparatus builds a record locator table in high speed semiconductor memory which comprises the unique record identifiers for the records on the storage medium as well as a record locator index generated by the apparatus, which indicates the address of the data record on the storage medium. Data retrieval is facilitated by first searching the record locator table in high speed semiconductor memory for a requested data record. Utilizing the record locator index associated with the reqested data record, the system directly accesses the requested data record on the storage medium thereby minimizing storage medium search time. Also disclosed is an apparatus and method for converting CKD formatted data records to FBA formatted disk drives and for building and compressing the 'count' portion of the CKD data formatted record into a record locator table.

Two data storage systems are interconnected by a data link for remote mirroring of data. Each volume of data is configured as local, primary in a remotely mirrored volume pair, or secondary in a remotely mirrored volume pair. Normally, a host computer directly accesses either a local or a primary volume, and data written to a primary volume is automatically sent over the link to a corresponding secondary volume. Each remotely mirrored volume pair can operate in a selected synchronization mode including synchronous, semi-synchronous, adaptive copy - remote write pending, and adaptive copy - disk. Direct write access to a secondary volume is denied if a 'sync required' attribute is set for the volume and the volume is not synchronized. If a 'volume domino' mode is enabled for a remotely mirrored volume pair, access to a volume of the pair is denied when the other volume is inaccessible. In a 'links domino' mode, access to all remotely mirrored volumes is denied when remote mirroring is disrupted by an all-links failure. The domino modes can be used to initiate application-based recovery, for example, recovering a secondary data file using a secondary log file. In an active migration mode, host processing of a primary volume is concurrent with migration to a secondary volume. In an overwrite cache mode, remote write-pending data in cache can be overwritten. Write data for an entire host channel command word chain is bundled in one link transmission.

Growing community of inventors

Newton, MA, United States of America

Bruno Alterescu