Lemon Inc.

Beijing Volcano Engine Technology Co., Ltd.

Peng Xu

Fei Liu

Kyoungryun Bae

Chaohong Hu

Sheng Qiu

Ping Zhou

Kan Frankie Fan

Prathamesh Amritkar

Jinhyuk Kim

Hui Zhang

Longxiao Li

Wei Tang

Ming Lin

Hao Wang

Yang Liu

Yan Sun

Shan Xiao

Di Xu

Jinwei Xie

Ken Hu

Bhanu Gogineni

Dengcheng Zhu

Changyou Xu

Hyungjin Im

Kyung Ho Kim

A computing device for verifying data integrity is provided, comprising a memory controller configured to receive a plurality of original data blocks. Each original data block has an associated initial CRC value. The memory controller then segments and recombines the received data blocks into logic blocks, and calculates a new logic block CRC value for each logic block. The logic blocks are transmitted with their respective new logic block CRC values to a storage device, and the logic blocks are written to non-volatile memory of the storage device in a write operation. After the write operation, a combined CRC value is calculated for the logic blocks and a combined CRC value for the original data blocks, and compare the combined CRC values. The memory controller determines whether the combined CRC values match. When they match, the memory controller generates a verification response verifying the integrity of the write operation.

Device and methods for managing the data integrity of read and write operations

Described are examples for performing garbage collection in a file system having multiple zones of data. A garbage rate associated with an amount of invalid data in the zone can be computed for each zone of the multiple zones in the file system. One or more candidate zones, of the multiple zones, can be determined for garbage collection based on the garbage rate and a sequence number assigned to the zone. Garbage collection of the one or more candidate zones in the file system can be performed.

Techniques for garbage collecting zones in a file system

A computing system for verifying data integrity is provided, including a host device comprising a memory controller, and a storage device. The memory controller receives original data blocks, each having an associated initial CRC value. The memory controller then segments and recombines the data blocks into logic blocks. The storage device is configured to write the logic blocks to its non-volatile memory of the storage device in the write operation, calculate a new logic block (LB) CRC value for each logic block, and calculate a combined LB CRC value. After the write operation, the memory controller combines duplicated copies of a given CRC value for each of the original data blocks, then combines them together to calculate a combined segments CRC value, and compares the combined segments CRC value to the combined LB CRC value. When the combined CRC values match, a verification response is generated verifying data integrity.

System and methods for managing the data integrity of read and write operations

A network storage system comprises a first application node, storage nodes, and a switch fabric comprising switches providing data paths. Each data path connects the first application node to a storage node of the plurality of storage nodes. The system further comprises a control plane software agent. The control plane software agent configures the network storage system to receive, via the first application node, a request for storing a file, select a first storage node, initialize a file identifier for the file based on a network topology of the switch fabric and the storage nodes, and store the file on the first storage node. The file identifier describes the first storage node, a storage location in the first storage node, and a first data path of the data paths. The first data path includes a first set of switches connecting the first application node to the first storage node.

Scalable autonomous storage networks

This disclosure describes a non-volatile storage device includes a non-volatile storage and a controller. The controller includes a data evaluator to evaluate each block of data stored in the non-volatile storage, the evaluation being made in accordance with multiple integrity factors; a factor evaluator to provide a weight to each of the multiple integrity factors for each of the multiple blocks of data, aggregate the multiple weighted integrity factors for each of the multiple blocks of data, and identify one of the multiple blocks of data stored in the non-volatile storage for which the aggregated weight integrity factors is highest; and a scanner to perform at least one media scan of the identified block of data stored in the non-volatile storage, e.g., NAND flash memory.

Weighted non-volatile storage media scans

A method is directed to storing data in a non-volatile storage. The method includes writing sequentially at least a main portion of a data record in one or more logic blocks of an append-only storage zone of the non-volatile storage until the one or more first logic blocks are written full. The method also includes generating a first journal including a remainder portion of the first data record and a first journal entry for the remainder portion. A storage device control system includes a non-volatile storage and a controller for the non-volatile storage.

Journal based data storage in block-level storage

A method for adaptive mapping for data compression includes determining an input/output (I/O) request pattern, dynamically switching between a segment mapping mode and a flat hash table mapping mode based on the determined I/O request pattern, updating a shared mapping table for the segment mapping mode and the flat hash table mapping mode, and adjusting an entry of the mapping table based on the determined I/O request pattern and a status of the entry.

Adaptive mapping for transparent block device level compression

A system and method are described to efficiently allocate memory space with low latency overhead by allocating blocks of non-volatile memory on a storage device according to a tree data structure comprising a plurality of counter sets, each counter set including one or a plurality of counters indicating numbers of unallocated blocks of memory space within the non-volatile memory.

System and method for allocating memory space

Described are examples for storing data on a storage device, including storing, in a live write stream cache, one or more logical blocks (LBs) corresponding to a data segment, writing, for each LB in the data segment, a cache element of a cache entry that points to the LB in the live write stream cache, where the cache entry includes multiple cache elements corresponding to the multiple LBs of the data segment, writing, for the cache entry, a table entry in a mapping table that points to the cache entry, and when a storage policy is triggered for the cache entry, writing the multiple LBs, pointed to by each cache element of the cache entry, to a stream for storing as contiguous LBs on the storage device, and updating the table entry to point to a physical address of a first LB of the contiguous LBs on the storage device.

Techniques for instance storage using segment-based storage

Described are examples for storing, in a first zone cache, one or more logical blocks (LBs) corresponding to a data chunk, writing, for each LB in the data chunk, a cache element of a cache entry that points to the LB in the first zone cache, where the cache entry includes multiple cache elements corresponding to the multiple LBs of the data chunk, writing, for the cache entry, a table entry in a mapping table that points to the cache entry, and when a storage policy is triggered for the cache entry, writing the multiple LBs, pointed to by each cache element of the cache entry, as contiguous LBs in an isolation block for the data chunk in a second zone stream, and updating the table entry to point to the isolation block in the second zone stream.

Growing community of inventors

Los Angeles, CA, United States of America

Peng Xu