Lemon Inc.

Beijing Volcano Engine Technology Co., Ltd.

Kyoungryun Bae

Peng Xu

Fei Liu

Sheng Qiu

Prathamesh Amritkar

Jinhyuk Kim

Chaohong Hu

Wei Tang

Ming Lin

Hao Wang

Yang Liu

Yan Sun

Shan Xiao

Kyung Ho Kim

Jinwei Xie

Hyungjin Im

Ken Hu

Dengcheng Zhu

Bhanu Gogineni

A computing device for verifying data integrity is provided, comprising a memory controller configured to receive a plurality of original data blocks. Each original data block has an associated initial CRC value. The memory controller then segments and recombines the received data blocks into logic blocks, and calculates a new logic block CRC value for each logic block. The logic blocks are transmitted with their respective new logic block CRC values to a storage device, and the logic blocks are written to non-volatile memory of the storage device in a write operation. After the write operation, a combined CRC value is calculated for the logic blocks and a combined CRC value for the original data blocks, and compare the combined CRC values. The memory controller determines whether the combined CRC values match. When they match, the memory controller generates a verification response verifying the integrity of the write operation.

Device and methods for managing the data integrity of read and write operations

Described are examples for performing garbage collection in a file system having multiple zones of data. A garbage rate associated with an amount of invalid data in the zone can be computed for each zone of the multiple zones in the file system. One or more candidate zones, of the multiple zones, can be determined for garbage collection based on the garbage rate and a sequence number assigned to the zone. Garbage collection of the one or more candidate zones in the file system can be performed.

Techniques for garbage collecting zones in a file system

A computing system for verifying data integrity is provided, including a host device comprising a memory controller, and a storage device. The memory controller receives original data blocks, each having an associated initial CRC value. The memory controller then segments and recombines the data blocks into logic blocks. The storage device is configured to write the logic blocks to its non-volatile memory of the storage device in the write operation, calculate a new logic block (LB) CRC value for each logic block, and calculate a combined LB CRC value. After the write operation, the memory controller combines duplicated copies of a given CRC value for each of the original data blocks, then combines them together to calculate a combined segments CRC value, and compares the combined segments CRC value to the combined LB CRC value. When the combined CRC values match, a verification response is generated verifying data integrity.

System and methods for managing the data integrity of read and write operations

A network storage system comprises a first application node, storage nodes, and a switch fabric comprising switches providing data paths. Each data path connects the first application node to a storage node of the plurality of storage nodes. The system further comprises a control plane software agent. The control plane software agent configures the network storage system to receive, via the first application node, a request for storing a file, select a first storage node, initialize a file identifier for the file based on a network topology of the switch fabric and the storage nodes, and store the file on the first storage node. The file identifier describes the first storage node, a storage location in the first storage node, and a first data path of the data paths. The first data path includes a first set of switches connecting the first application node to the first storage node.

Scalable autonomous storage networks

This disclosure describes a non-volatile storage device includes a non-volatile storage and a controller. The controller includes a data evaluator to evaluate each block of data stored in the non-volatile storage, the evaluation being made in accordance with multiple integrity factors; a factor evaluator to provide a weight to each of the multiple integrity factors for each of the multiple blocks of data, aggregate the multiple weighted integrity factors for each of the multiple blocks of data, and identify one of the multiple blocks of data stored in the non-volatile storage for which the aggregated weight integrity factors is highest; and a scanner to perform at least one media scan of the identified block of data stored in the non-volatile storage, e.g., NAND flash memory.

Weighted non-volatile storage media scans

A method is directed to storing data in a non-volatile storage. The method includes writing sequentially at least a main portion of a data record in one or more logic blocks of an append-only storage zone of the non-volatile storage until the one or more first logic blocks are written full. The method also includes generating a first journal including a remainder portion of the first data record and a first journal entry for the remainder portion. A storage device control system includes a non-volatile storage and a controller for the non-volatile storage.

Journal based data storage in block-level storage

Described are examples for storing, in a first zone cache, one or more logical blocks (LBs) corresponding to a data chunk, writing, for each LB in the data chunk, a cache element of a cache entry that points to the LB in the first zone cache, where the cache entry includes multiple cache elements corresponding to the multiple LBs of the data chunk, writing, for the cache entry, a table entry in a mapping table that points to the cache entry, and when a storage policy is triggered for the cache entry, writing the multiple LBs, pointed to by each cache element of the cache entry, as contiguous LBs in an isolation block for the data chunk in a second zone stream, and updating the table entry to point to the isolation block in the second zone stream.

Techniques for zoned namespace (ZNS) storage using multiple zones

Growing community of inventors

Los Angeles, CA, United States of America

Kyoungryun Bae