Emc Corporation

Emc IP Holding Company LLC

Dell Products Inc.

Amnon Naamad

Marik Marshak

Adnan Sahin

Sean C Dolan

Dan Aharoni

Hui Wang

Sachin More

Alexandr Veprinsky

Alex Veprinsky

Owen Martin

Yechiel Yochai

Xiaomei Liu

Ron Arnan

Ahmet Kirac

Arieh Don

Barry A Burke

John S Harwood

David Lionel Black

David Stephen Reiner

Ron Bigman

Anurag Singh Maunder

Hagay Dagan

Lee W Sapiro

Gil Ratsaby

Kenneth Goguen

Xiaoyan Wei

Joe Murphy

Kuram T Narayana

Roy E Clark

Peng Wu

Rong Yu

Malak Alshawabkeh

John T Fitzgerald

Kenneth J Taylor

Stephen Richard Ives

Yaron Dar

Jeffrey Wilson

Peng Yin

Josef Ezra

Orit Levin-Michael

David Shadmon

Ningdong Li

Fatemeh Azmandian

David P Moloney

John W Lefferts

Igor Patlashenko

Maureen Lally

Dimitar Petkov Gueorguiev

Sanjay Narahari

Orit Levin Michael

Brad Corey Maltz

John A Adams

Manickavasasaham M Senghuden

John Kitchen

Ian Adams

Described are techniques for modeling processing performed in a data storage system. Inputs received may include a plurality of workloads each denoting a workload for one of a plurality of storage groups, a plurality of service level objectives each denoting a target level of performance for one of the plurality of storage groups, a plurality of capacities each denoting a storage capacity of one of a plurality of storage tiers, and a plurality of maximum workloads each denoting a maximum workload capability of one of the plurality of storage tiers. Using the inputs, placement of data of the plurality of storage groups on the plurality of storage tiers may be modeled. Output(s) may be generated based on the modeling where the output(s) may include an amount of each of the plurality of storage tiers allocated by modeling to each of the plurality of storage groups.

Data storage system modeling using application service level objectives and specified workload limits for storage tiers

A method of cache hit ratio simulation using a partial data set includes determining a set of sampled addresses, the set of sampled addresses being a subset of all addresses of a storage system of a storage environment. The method further includes using, by a simulation engine, a cache management algorithm to determine a cache hit ratio of the sampled addresses, the cache management algorithm being also used by a cache manager to place a portion of the addresses of the storage system into cache during a runtime operation. The method further includes determining a quantity of memory access operations to frequently accessed addresses in the set of sampled addresses, and correcting, by the simulation engine, the cache hit ratio of the sampled addresses based on the quantity of memory access operations to the frequently accessed addresses in the set of sampled addresses. The simulation also handles sequential operations accurately.

Cache hit ratio simulation using a partial data set

Improved techniques for applying performance controls in a data storage system based on overload correlations between units of managed storage objects (UMOs). When a performance indicator (e.g. response time) for a target UMO is outside an acceptable range, a competing UMO that potentially shares at least one potentially shared hardware component with the target UMO is identified. An overload correlation between the target UMO and the competing UMO is generated that indicates an amount of correlation between the performance indicator for the target UMO and a performance indicator for the competing UMO. A performance control is then applied to the throughput of the competing UMO that reduces the throughput of the competing UMO. The amount that the throughput of the competing UMO is reduced is based on the amount of overload correlation between the target UMO and the competing UMO.

Using overload correlations between units of managed storage objects to apply performance controls in a data storage system

Dynamic resource partitioning techniques may include receiving a plurality of performance goals for a plurality of consumers, each of the plurality of performance goals denoting a performance goal for a different one of the plurality of consumers; performing first processing to determine whether one or more of a plurality of subsystems are overloaded and whether there is at least a first consumer of the plurality of consumers violates a corresponding one of the plurality of performance goals specified for said first consumer; and responsive to determining that one or more of the plurality of subsystems are overloaded and that at least a first consumer is not meeting the corresponding one of the plurality of performance goals specified for said first consumer, performing second processing to reduce workload directed to each of the one or more subsystems that are overloaded.

Dynamic resource partitioning

Control over the overall data cache hit rate is obtained by managing partitioning caching responsibility by address space. Data caches determine whether to cache data by hashing the data address. Each data cache is assigned a range of hash values to serve. By choosing hash value ranges that do not overlap, data duplication can be eliminated if desired, or degrees of overlap can be allowed. Control over hit rate maximization of data caches having best hit response times is obtained by maintaining separate dedicated and undedicated partitions within each cache. The dedicated partition is only used for the assigned range of hash values.

Controlling aggregate read hit rate across a hierarchy of cache levels by partitioning responsibility for caching among the cache levels

A method, computer program product, and computing system for defining one or more computing system requirements for desired data storage array. One or more design criteria is defined for the desired data storage array. At least one recommended data storage array is identified for the desired data storage array based, at least in part, upon the one or more computing system requirements and the one or more design criteria.

Recommendation system and method

For each storage array in a storage system, a single value score indicative of the overall health of the respective storage array is calculated. Storage array health score may be tracked over time and used to identify storage arrays in need of maintenance. The storage array health score may be calculated as a composite of four component scores: physical component health, logical component health, Service Level Objective compliance and Best Practice Configuration Compliance. The physical component and logical component scores may be based on multiple different category health scores, and each category health score may be based on multiple instance health scores. Health scores may be used to identify remedial actions and predict health score increase as a result of remedial actions.

Storage array health score

Described are techniques for determining data storage system configurations. Inputs are provided to a data storage system configuration generator. The inputs include first inputs and second inputs. The first inputs include a performance objective, a storage capacity, and input(s) characterizing an I/O workload. The second inputs characterize performance of data storage system components and costs of the data storage system components. First processing is performed by the data storage system configuration generator in accordance with the inputs to determine a set of one or more candidate data storage system configurations. The data storage system configuration selects, in accordance with one or more criteria, a first candidate data storage system configuration from the set.

Techniques for determining a storage configuration

Determining cumulative workload skew is described. Measurements for one or more logical devices are determined. The set of measurements include, for each of N storage tiers, a workload measurement identifying workload directed to the single tier, and a capacity measurement identifying an amount of data stored in the single tier. N points may be determined using the measurements. Each point corresponds to a different storage tier and has a first coordinate identifying a cumulative percentage of data portions stored in the storage tier and all other tiers having a higher performance ranking than the one storage tier, and a second coordinate denoting an aggregated percentage of total workload directed to the foregoing cumulative percentage of data portions. A curve representing a cumulative workload skew may be determined using these N points and a point of origin.

Techniques for determining workload skew

Described are techniques for evaluating data movement alternative. A set of criteria including capacity and performance limits is received. First processing is performed to evaluate a plurality of alternatives for use in data movement with respect to a set of logical devices having data stored on a set of physical storage devices. Each of the plurality of alternatives includes a different set of data movement criteria comprising capacity limits and a different set of performance limits. The set of physical storage devices includes at least a first physical device of one of a plurality of storage tiers and a second physical device of another one of the plurality of storage tier. One of the sets of performance limits is selected in accordance with the first processing.

Techniques for automated evaluation and movement of data between storage tiers for thin devices

Described are techniques for destaging data. Write data for write operations are stored in cache page(s). The cache may be partitioned into cache pages and write data stored thereon may be marked as write pending denoting that write data needs to be written out to physical storage. Weight values may be determined for the cache pages in accordance with factors. A first cache page may be selected having a highest such weight value where the selected first cache page includes at least some write data marked as write pending. The write data of the selected first cache page may be destaged to physical storage.

Optimizing destaging of data to physical storage devices

An efficient linear technique is used to determine allocation of tiered storage resources among data extents based on system performance and SLOs. Efficiency is achieved by first determining a system performance boundary condition via hardware performance modeling under desirable system performance zones. SLOs are then balanced and SLO achievement improved by exchanging workload activities among SG donors and SG receivers while system performance boundary conditions are maintained. Remaining unutilized capacity is the uniformly distributed to further improve SLO achievement.

Allocation method for meeting system performance and application service level objective (SLO)

The system described herein allows for picking data to be moved from one physical location to another using certain criteria, such as expected activity level, to achieve load balancing or load optimization. Migrating data for a logical device includes subdividing the logical device into subsections, where each of the subsections corresponds to a particular address range of the logical device that is mapped to a physical device containing corresponding data and copying data for a first subsection from a first physical device to a second, different, physical device, where data for a second subsection is maintained indefinitely on the first physical device after copying the data for the first subsection to the second physical device. The first physical device may be provided in a different geographic location than the second physical device.

Selective migration of physical data

Growing community of inventors

Brookline, MA, United States of America

Amnon Naamad