Huawei Technologies Co., Limited

Other

Ruliang Dong

Jinyi Zhang

Liang Chen

Pei Wu

Qiang Xue

Kebo Fu

Jianhong Tu

Jianqiang Shen

Yanxing Zeng

Xiang Wu

Qiang Liu

Xiaodong Luo

Gongyi Wang

Haixin Wang

Haixiao Jiang

Qizhao Yuan

A data processing method is provided. The method includes: obtaining a parameter related to performance of a memory of a storage node, adjusting an aggregation policy based on the parameter, aggregating a first input output IO request in the memory into a second IO request based on an adjusted aggregation policy, and performing persistent storage on data corresponding to the second IO request.

Data processing method and related device

A data prefetch method includes before data is prefetched, a first data access request that is first obtained, and a data prefetch policy that is determined based on the first data access request and a data lifecycle such that a first data set stored in a second storage medium is stored into a first storage medium according to the data prefetch policy. The first data set includes at least one piece of data, the data prefetch policy includes at least a prefetch length, the data lifecycle indicates duration for storing data in the first storage medium, and a read/write access rate of the second storage medium is less than that of the first storage medium.

Data prefetch method and apparatus, and device

A method describes that a lost first block in a first stripe is directly reconstructed based on a first result obtained from a target quantity of storage devices, so that there is no need to read an unlost block in the first stripe. The first block may be reconstructed provided that the target quantity of first results are obtained. An amount of data of the first result is less than that of the unlost block in the first stripe. Therefore, a data transmission process occupies less network bandwidth, and this improves block reconstruction performance.

Data reconstruction method and apparatus, computer device, and storage medium and system

In a data storage method, a storage system comprises first and second medium layers for data storage, wherein the performance of the first medium layer is different from the performance of the second medium layer. Based on the performance difference between the two layers, the storage system stores data in the first medium layer and the second medium layer based on different erasure code ratios. The different erasure code ratios correspond to different write amplification, and result in different storage space utilization.

Migrating data between different medium layers of a storage system

A method and apparatus for determining stripe consistency, including an operation node that obtains n groups of CRC data blocks corresponding to a target stripe, where the target stripe includes n first data blocks, the n first data blocks include k original data blocks and m EC data blocks of the k original data blocks, the n groups of CRC data blocks are respective CRC data blocks of n groups of second data blocks, one group of second data blocks includes m transformation results obtained by performing m times of EC transformation on one first data block, both k and m are positive integers, and n=m+k.

Method for determining stripe consistency and apparatus

A method for obtaining a storage system capacity is provided. An available capacity that is of a storage system and that is associated with each stripe length is obtained based on an obtained stripe length that can be effectively configured. Therefore, an available capacity of a system is optimally selected.

Method and apparatus for calculating storage system available capacity

An erasure code (EC)-based data processing method implemented by a storage controller includes obtaining K data chunks, dividing each of the K data chunks into two data slices, encoding the 2*K data slices based on a parity matrix including 2*M rows and 2*(K+M) columns of elements, to obtain 2*M parity slices, and separately storing the K data chunks and the M parity chunks in different storage devices.

Growing community of inventors

Hangzhou, China

Ruliang Dong