Sk Hynix Memory Solutions Inc.

Omnitier Storage, Inc.

Skhynix Inc.

Omnitier, Inc.

Suneel Indupuru

Derrick Preston Chu

Daryl Ng

Jason Bellorado

Zheng Wu

Arunkumar Subramanian

Hong Lu

Prasanth Kumar

Nahir Sarmicanic

An application and a plurality of types of storage in a distributed storage system are communicated with. A write instruction that includes a key-value pair that in turn includes a key and value is received from the application. The key-value pair is stored in a selected one of the plurality of types of storage where the selected type of storage is selected based at least in part on a size or access frequency of the key-value pair. A link to the stored key-value pair is stored, including by: generating a key hash based at least in part on the key from the key-value pair and selecting one of a plurality of rows in an extensible primary table in an index based at least in part on the key hash. If it is determined there is sufficient space, the link to the stored key-value pair is stored, in the selected row. If it is determined there is insufficient space, the key-value pair is stored in an overflow row in a secondary table.

Indexing technique for large scale distributed key-value systems

A plurality of pieces of write data are aggregated on a buffer to obtain a segment where the segment exceeds a smallest write size supported by storage. An address on the storage is determined for the segment. Location information and identifier(s) associated with the segment are recorded where the location information points to the storage, as opposed to the buffer, while the write data is being aggregated. When the write data has been aggregated into the segment, the segment is written to the storage wherein the location information remains unchanged in response to the writing to the storage.

Large segment management

Data to be stored is received from an application. A first type of storage, having a first set of storage properties, and a second type of storage, having a second set of storage properties, are selected from based on an access characteristic associated with the data, the first set of storage properties, and the second set of storage properties. The data is stored in the selected type of storage.

Application defined storage device

Data associated with logical addresses are received where the data is to be stored on a plurality of solid state storage dies and each of the plurality of solid state storage dies is independently accessible. Metadata is generated that includes the logical addresses where the metadata and the data sum to an amount of information that is less than a maximum amount of information that can be written to the plurality of solid state storage dies in a single write operation. The metadata and the data are stored in the plurality of solid state storage dies.

Sub-blocks and meta pages for mapping table rebuild

A workload level associated with an expandable data buffer is determined, where the expandable data buffer and an expandable mapping table cache are stored in internal memory and the expandable mapping table cache is used to store a portion of a mapping table that is stored on external storage. An amount of internal memory allocated to the expandable data buffer and an amount of internal memory allocated to the expandable mapping table cache are adjusted based at least in part on the workload level.

Workload-based adjustable cache size

An instruction to write data to a write logical address is received where the write logical address is a member of a group of one or more logical addresses. It is determined if data associated with any of the logical addresses in the group of logical addresses has been written to any of a plurality of open groups of locations. If so, the data is written to the open group of locations to which data from the group of logical addresses has already been written to. If not, an open group of locations to write to is selected from the plurality of open groups of locations.

Growing community of inventors

Cupertino, CA, United States of America

Suneel Indupuru