Emc IP Holding Company LLC

Jialei Wu

Ao Sun

Yu Teng

Lu Lei

Chen Xiao Wang

Wei Gao

Shashwat Srivastav

Dong Wang

Sriram Sankaran

Jun Luo

Ronnie Yu Cai

Chunxi Cheng

Embodiments of the present disclosure relate to a method, device and computer program product for data stream processing. The method comprises activating, in response to receiving a starting first predefined tag in a first input data stream from a first data source, a duplicate process of a process by duplicating a state of the process to the duplicate process. The method further comprises processing, by the duplicate process, only a data unit before an ending second predefined tag in a second input data stream from a second data source without interruption of processing of the first and second input data streams by the process. The second data source differs from the first data source. The method further comprises creating a snapshot of the duplicate process for recovery of the process due to failure in response to receiving the ending second predefined tag in the second input data stream.

Method, device and computer program product for data stream processing

Techniques provide for rebuilding data. Such techniques involve: obtaining health status information related to a first disk of a storage system, the first disk being divided into a plurality of disk units, and the health status information indicating a failure of a first disk unit of the plurality of disk units; determining a data block stored in the first disk unit based on a mapping between data blocks for the storage system and storage locations; and rebuilding the data block into a second disk of the storage system when maintaining accessibility of other data blocks in other disk units of the first disk than the first disk unit. Accordingly, it is possible to improve the data rebuilding efficiency when a disk fails partly and to continue utilizing the storage space portion in the disk that is not failed, without making the disk be offline temporarily.

Method, device, and computer program product for rebuilding data

A computer program product, system, and method for generating and storing a parity chunk using at least a first chunk and a second chunk; detecting at least one unused segment within the first chunk; generating a new chunk as a third chunk; associating one or more used segments from the first chunk to the third chunk; filling an unused segment within the third chunk with new data; calculating a delta parity between the first chunk and the third chunk; and updating the stored parity chunk using the delta parity.

Efficient garbage collection for distributed storage with forward error correction

Growing community of inventors

Shanghai, China

Jialei Wu