Emc Corporation

Emc IP Holding Company LLC

Steve Morley

David W DesRoches

Robert C Solomon

John Percy

Daniel E Cummins

Vamsi K Vankamamidi

William C Davenport

David W Harvey

Rasa Raghavan

Don Hon

Bruce Harmon

Systems and methods for performance tuning a computer system in scaling domains based on quantified scalability. A system includes a processor configured to: calculate an estimate of parallel fraction and speedup characteristic in a first domain D1 and in a second domain D2 for an application, the estimate being calculated using system performance measurements generated from previous processing iterations of one or more workloads of the application using a number, n, of cores in the first domain and a remaining number, N−n, of cores in the second domain to obtain performance values X(n) and X(N−n), wherein N represents a total number of cores; calculate the number of cores for the first domain using a quadratic equation generated from the parallel fraction and performance value in each domain; and execute the application in each domain using the number of cores for each domain.

Performance tuning a computer system in scaling domains based on quantified scalability

Techniques are disclosed for determining ownership of a data segment. The techniques include providing a data segment in a data storage appliance that facilitates multiple references of the data segment by one or more storage entities. The techniques also include maintaining a plurality of counts in connection with the data segment, the plurality of counts comprising (i) a first count representing a sum of first values that identify the respective storage entities associated with each reference of the data segment, (ii) a second count representing a sum of second values that derive from key values of the respective storage entities associated with each reference of the data segment, and (iii) a third count representing a number of references of the data segment by the respective storage entities. The techniques also include determining whether the said storage entity exclusively owns the data segment based on the plurality of counts and a key value of one of the respective storage entities.

Method, apparatus and computer program product for determining ownership of a data segment

An improved technique involves processing a workflow in stages, and processing all requests in a queue for a given stage before moving onto the next stage. Along these lines, each request received by a storage processor is assigned to a core and placed in a first queue for that core. Within that core, a single system thread executes first instructions for a task, e.g., checking the storage cache for the requested data from a request, and then transfers the request to a second queue. Rather than perform additional tasks to completely satisfy the request, however, the thread executes the first instructions for a prespecified number of requests in the first queue. Only when the thread has executed instructions for the prespecified number of requests, the thread begins execution of second instructions for requests in the second queue, and work on the next task begins.

Techniques for increasing storage system performance in processor-bound workloads with large working sets and poor spatial locality

A system and method for storing data, the system having one or more storage devices, caches data from a sender into a first random-access structure located in a first cache level, caches data from the first cache level into a log structure located in a second cache level, and stores data from CL into a second random-access structure located in a storage level, wherein CL is the first cache level or the second cache level. In further embodiments of the invention, the second cache level caches in the log structure parity data for the data cached in the log structure. In a still further embodiment of the invention, the storage level stores in the second random-access structure parity data for the data stored in the second random-access structure.

System and method for hierarchical data storage

A system and method for cleaning a log structure, the log structure including one or more segments, each segment including live data, orders the one or more segments into a hot list according to age, with the youngest segment at the beginning of the hot list and the oldest segment at the end of the hot list, the youngest segment being the most recently used segment and the oldest segment being the least recently used segment, pushes one or more of the oldest segments in the hot list to a cleaning matrix, the cleaning matrix grouping segments according to age and percent of live data in the segment, traverses the cleaning matrix looking for a segment, determines whether enough live data has been found to write a complete segment, sequentially repeats the previous two processes until enough live data has been found to write a complete segment, reads data from the one or more found segments, and writes the read live data into an unused segment.

System and method for cleaning a log structure

An apparatus and method for preparing a disk for use in a disk array, the disk array including an input/output control processor, the disk including sectors, the sectors including a data area and a metadata area, the method comprising defining a range of sectors to prepare for use in the disk array, sending a command to the disk from the input/output control processor, the command instructing the disk to write a block of initial state data to each sector in a group of sectors on the disk, the group of sectors on the disk located within the range of sectors on the disk, and writing the block of initial state data to each of the sectors on the disk. The block of initial state data comprises a bit stream of data for writing to the data area and the metadata area of each sector.

Method and apparatus for preparing a disk for use in a disk array

A system and method for expanding a log structure in a disk array, the disk array being expanded from M-width to N-width, the disk array including a storage level, the log structure including one or more sequential used segments, the one or more sequential used segments including live data, locates one or more sequential used segments, writes live data from the one or more located segments to the storage level, enlarges the size of the one or more located segments from M-width to N-width, and places the one or more enlarged segments on a first free segment list.

Growing community of inventors

Upton, MA, United States of America

Steve Morley