Omnitier Storage, Inc.

Omnitier, Inc.

Daryl Ng

Derrick Preston Chu

Suneel Indupuru

Prasanth Kumar

An application and a plurality of types of storage in a distributed storage system are communicated with. A write instruction that includes a key-value pair that in turn includes a key and value is received from the application. The key-value pair is stored in a selected one of the plurality of types of storage where the selected type of storage is selected based at least in part on a size or access frequency of the key-value pair. A link to the stored key-value pair is stored, including by: generating a key hash based at least in part on the key from the key-value pair and selecting one of a plurality of rows in an extensible primary table in an index based at least in part on the key hash. If it is determined there is sufficient space, the link to the stored key-value pair is stored, in the selected row. If it is determined there is insufficient space, the key-value pair is stored in an overflow row in a secondary table.

Indexing technique for large scale distributed key-value systems

A plurality of pieces of write data are aggregated on a buffer to obtain a segment where the segment exceeds a smallest write size supported by storage. An address on the storage is determined for the segment. Location information and identifier(s) associated with the segment are recorded where the location information points to the storage, as opposed to the buffer, while the write data is being aggregated. When the write data has been aggregated into the segment, the segment is written to the storage wherein the location information remains unchanged in response to the writing to the storage.

Large segment management

Data to be stored is received from an application. A first type of storage, having a first set of storage properties, and a second type of storage, having a second set of storage properties, are selected from based on an access characteristic associated with the data, the first set of storage properties, and the second set of storage properties. The data is stored in the selected type of storage.

Growing community of inventors

San Jose, CA, United States of America

Daryl Ng