Scaleflux, Inc.

Lsi Corporation

Yang Liu

Fei Sun

Hao Zhong

Tong Zhang

Mark Vernon

Jiangpeng Li

Timothy Lawrence Canepa

Wentao Wu

Changyou Xu

Qi Wu

Nital P Patwa

Dong Ping Zhang

Yong Peng

Chien Chen

Thad Omura

Dan Liu

Linqiang Ouyang

Kelly Fitzpatrick

Jinchao Lyu

A system and method for providing compression and error correction coding (ECC) in a solid-state drive (SSD). A method is provided that includes: determining whether a data item is to be written to flash memory using a general-purpose mode or a zero-padding mode: in response to a determination that a data item is to be written into flash memory using the zero-padding mode: padding the data item with an all-zero tail to form an LBA data block of a predefined size; performing ECC coding on the LBA block to generate an ECC codeword; removing the all-zero tail from the ECC codeword to generate a shortened ECC codeword; and storing the shortened ECC codeword in flash memory.

Solid-state drive with multimode compression and error correction

A self-managed DRAM module configured to reduce energy consumption. A module is described that includes a plurality of DDR channels and a management engine configured to read and write data blocks to DDR channels according to a process that includes: allocating a set of sub-channels for each DDR channel, wherein each sub-channel includes a subset of the set of DRAM chips; wherein a write operation of a data block includes: encoding the data block to generate an ECC codeword; and writing the ECC codeword into the subset of DRAM chips of a specified sub-channel; and wherein a read operation of the data block includes: reading the ECC codeword from the subset of DRAM chips of the specified sub-channel; and decoding the ECC codeword to obtain the data block.

Reducing energy consumption of self-managed DRAM modules

A hardware decompression acceleration engine including: an input buffer for receiving to-be-decompressed data from a software layer of a host computer; a decompression processing unit coupled to the input buffer for decompressing the to-be-decompressed data, the decompression processing unit further receiving first and second flags from the software layer of the host computer, wherein the first flag is indicative of a location of the to-be-decompressed data in a to-be-decompressed data block and the second flag is indicative of a presence of an intermediate state; and an output buffer for storing decompressed data from the decompression processing unit.

Techniques to enable stateful decompression on hardware decompression acceleration engines

A storage device that provides in-storage transparent compression and implements a process for processing write requests during an out-of-space state. The process includes: receiving a write request from a host involving a set of logical block addresses (LBAs); determining if each of the LBAs in the write request is an actively used LBAs; and in response to determining that each of the LBAs in the write request are actively used LBAs, allowing the write request to be served; and in response to determining that at least one of the LBAs in the write request is not an actively used LBAs, not allowing the write request to be served and returning an error to the host.

Techniques to enhance storage devices with built-in transparent compression for mitigating out-of-space issues

A method according to embodiments includes: storing an entire hash table of a table R in memory of a computational storage device; storing a second table S in storage media of the computational storage device, the table R being smaller than the table S, wherein the hash JOIN operation is directed to combining a c-th column in the table S and a c-th column in the table R; wherein, for each row of the table S, the computational storage device configured to perform a method, including: applying a hash function to a value of the c-th column to provide a hash result; looking up the hash result in the hash table stored in the memory of the computational storage device; and if the hash result is found, sending the row of the table S and a corresponding row index of the table R to the host computing system.

Using in-storage computation to improve the performance of hash join for database and data analytics

The present disclosure relates to the field of solid-state data storage, and particularly to improving the speed performance and reducing the cost of solid-state data storage devices. A host-managed data storage system according to embodiments includes a set of storage devices, each storage device including a write buffer and memory; and a host coupled to the set of storage devices, the host including: a storage device management module for managing data storage functions for each storage device; memory including: a front-end write buffer; a first mapping table for data stored in the front-end write buffer; and a second mapping table for data stored in the memory of each storage device.

Integrating host-side storage device management with host-side non-volatile memory

A method for host-side data classification according to embodiments, includes: writing a data sector directly from a host to a storage device; storing the data sector in the storage device; sending a write completion acknowledgement from the storage device to the host; in the background: classifying the data sector on the host to estimate an expected lifetime of the data sector; assigning a data type index to the data sector based on the expected lifetime of the data sector; and asynchronously sending the data type index for the data sector from the host to the storage device.

Solid-state storage device speed performance and endurance through host-side data classification and embedded write caching

A host-assisted data deduplication system, including: a storage device including a controller, memory, and a write cache; and a host including a data duplication module coupled to the storage device, wherein the controller of the storage device is configured to write a data sector received from the host into the write cache in the storage device and to send a write completion to the host immediately after writing the data sector to the write cache; wherein the data duplication module is configured to detect whether the data sector is identical to another data sector stored in the memory of the storage device and to asynchronously send a duplicate detection result to the controller of the storage device, and wherein the controller of the storage device is configured to perform a data deduplication process for the data sector stored in the write cache based on the duplicate detection result.

Realizing host-assisted device-level data deduplication on solid-state data storage devices with embedded non-volatile memory

An infrastructure and method for storing compressed data. On a host, a data zero forcing system causes an unused portion at a tail end of a data sector to be forced to all zeros before being written. On a storage device comprising solid state memory, a zero tail detection system detects and removes a tail end of zeros in the data sector to create a variable size data chunk, and allocates a segment for storing the variable size data chunk. A variable size mapping system is provided that includes: a mapping table that maps a logical block address (LBA) of the variable size data chunk to a physical block address (PBA) entry, wherein the PBA entry includes a segment ID and an index; and a segment utilization table which, for each of a plurality of segments, provides a size of each variable size data chunk stored in the segment.

Data storage efficiency using storage devices with variable-size internal data mapping

An enhanced FTL system and method are provided for eliminating redundant write operations. A method is disclosed, including: processing a data write operation from a host that deploys a journaling scheme, wherein the data write operation includes a specified LBA that maps to a PBA in a SSD memory; calculating a signature of a data block during a write operation; detecting whether the data write should be handled as journal or non-journal write operation without assistance from the host; in response to a detected journal write operation, allocating a new PBA, writing the data block to the new PBA, updating a mapping table with a new LBA-PBA mapping, and inserting the signature into a signature table for the new LBA-PBA mapping; and in response to a detected non-journal write operation, mapping the specified LBA to an existing PBA if the signature matches a stored signature in the mapping table.

Enhancing flash translation layer to improve performance of databases and filesystems

A storage infrastructure, method and encoder device for implementing low complexity encoding, The described encoder includes: a preprocessing system that assigns a code length to each unique symbol based on the frequency without performing a sort operation and determines maximum and minimum occurrence frequencies of symbols of each given code length, and the maximum and minimum code length among all the symbols; and a post processing system that cycles through each code length, determines if a maximum occurrence frequency of a current code length, associated with a first symbol, is greater than a minimum occurrence frequency of an adjacent code length, associated with a second symbol, and if greater, swaps code lengths of the first and second symbols.

Storage infrastructure that employs a low complexity encoder

A system, method and program product for exploiting in-storage transparent compression. A storage infrastructure is disclosed that includes: a storage device having physical block address (PBA) storage of a defined capacity, a transparent compression system that compresses data written to the PBA storage, and a logical block address-to-physical block address mapping table; and a host having a memory management system that includes: an initialization system that allocates an amount of logical block address (LBA) storage for the host having a capacity greater than the defined capacity of the PBA storage, and that creates a dummy file that consumes LBA storage without consuming any PBA storage; a system that gathers current PBA and LBA usage information. The dummy file manager may adjust the size of the dummy file by truncating or appending sectors to the dummy file using a filesystem on the host, or using an allocation or deallocation function that does not incur any input/output (I/O) operations within the storage device. Dummy storage file sectors of the LBA storage may be mapped to dummy PBA storage that does not consume any physical storage in response to detecting a predefined content pattern indicative of dummy file sectors. The memory management system may device the LBA storage into partitions, with each partition receiving a dummy file.

Storage infrastructure and method for exploiting in-storage transparent compression using a dummy file that consumes LBA storage without consuming PBA storage

A storage aware memory controller for managing a physical storage system. A described controller: a system for mapping physical memory space into a memory region and a storage region; a system for applying different error protections schemes, in which a fine-grained memory fault tolerance scheme is applied to data in the memory region and a course-grained memory fault tolerance scheme is applied to data in the storage region; and a storage file system that includes a mapping table for mapping logical addresses to physical addresses for data stored in the storage region.

In-memory data storage with adaptive memory fault tolerance

A data storage system having a hashing engine for facilitating data deduplication. A device is provided that includes: a storage media; and a controller, wherein the controller includes a hashing engine for implementing a data deduplication process on data stored in the storage medium, wherein the hashing engine: inputs parameters from a host that specifies a sliding widow size and a boundary condition; implements a rolling hash function; and outputs a data chunk boundary.

Assisting data deduplication through in-memory computation

A system, method and program product that utilizes a hybrid fault tolerance system for managing data. A system includes: a system for partitioning memory into a set of partitions that includes a designated partition for storing immutable objects; a write system for storing an immutable object in the designated partition, wherein the immutable object is coded with a hardware-based fault tolerance system to generate a set of hardware-based codewords, and wherein the immutable object is further coded with a software-based fault tolerance system to generate a set of software-based codewords; a read system for retrieving the immutable object, wherein the read system decodes each hardware-based codeword for immutable object, and in response to a failed decoding of a hardware-based codeword, the read system decodes the software-based codeword containing a failed hardware-based codeword.

Growing community of inventors

Milpitas, CA, United States of America

Yang Liu