Emc IP Holding Company LLC

Fani Jenkins

Deepa Ramesh

Gobikrishnan Sundharraj

Abhinav Duggal

Nitin Madan

Ramprasad N Chinthekindi

Mahesh Kamat

Yamini Allu

Srikant Viswanathan

Kalidas Balakrishnan

Sudhanshu Goswami

Detecting a trend in latency for storage underlying a deduplicated file system includes generating a set of data points by recording when input/output (IO) requests were issued to the storage and recording time required to receive success responses from the storage. Least squares regression is performed on the data points to find a best-fit line through the data points. A slope of the best-fit line is calculated. A determination is made as to whether the slope is positive, a positive slope thereby indicating a trend of increasing latency of the storage. When the slope is determined to be positive, clients accessing the deduplicated file system are throttled.

Using machine learning techniques to flow control clients in a deduplication file system

Embodiments for reducing panic shutdown of components in a pipelined data processing system. Components are monitored for health, processing progress, and dependencies during normal system operation. A directed graph is generated showing non-circular dependencies of components in the pipeline. Deadlock of a particular component may or may not signal a panic condition depending on whether any of its presently downstream and depended on components are operating properly. The continuously monitored knowledge of proper operation of all downstream components is thus used to intelligently apply or defer panic alerts to keep the system operating uninterrupted from panic conditions that might soon or eventually be fixed by continued operation of the system pipeline.

Reducing false positive failure events in a health monitoring system using directional graphs

System generates data structure based on unique identifiers of objects in object storages and sets indicators in positions that correspond to hashes of unique identifiers of active objects. If a first number of regions of active data objects in first data storage and second number of regions of active data objects in second data storage each fail to satisfy data threshold, then system creates model identifying locations and sizes of regions of active data objects in first data storage and regions of active data objects in second data storage. System resets indicators in positions in data structure which correspond to hashes of unique identifiers of active data objects associated with model and enables remote storage to use model to copy regions of active data objects in first data storage and second data storage to third data storage, and to delete first data storage and second data storage.

Garbage collection based on transmission object models

Embodiments are described for reducing memory usage and disk I/O's for reading and writing streams in a deduplication storage system. Generations of backups of a stream can be tracked for the stream. In the first generation (first backup), stream data is ingested, segmented, and written to disk without looking up a fingerprint of each segment, to save disk I/O's and memory. After the first generation, an amount of stream data processed is tracked, and at dynamically tunable increments of data processed, a fingerprint index lookup is performed to disk. The fingerprint index is read into memory and subsequent fingerprint lookups are preformed to cache, until a next dynamically tunable fingerprint lookup to disk. The dynamically tunable increment of processed data can be randomly reset.

Dynamic de-duplication methodologies for efficient resource utilization on de-duplication system

Embodiments are directed to a method for preserving temporal locality in disk-based backup systems by receiving a plurality of save streams each comprising a data stream and a metadata stream, directing the data streams to a plurality of respective data containers, and the metadata streams to a single shared metadata container, and assigning metadata streams using the shared metadata container to their own respective compression region to preserve locality at the compression region level.

Growing community of inventors

Broomfield, CO, United States of America

Fani Jenkins