Amazon Technologies, Inc.

Meng Hu

Alazel Acheson

Mai-Lan Tomsen Bukovec

Nauman Zubaid Khan

A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a skew value associated with the key included in the request may be determined. The skew value may be determined based at least in part on the ratio of rate estimators, where the rate estimators represent a weighted average of the movement of the keys in a key space. If the skew value exceeds a threshold the service provider may take mitigating action.

Skew detector for data storage system

A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a counter associated with the prefix included in the request may be incremented, the counter may be configured to decay over time. If the counter exceeds a threshold the service provider may split the prefix associated with the counter and generate new partitions responsible for the split prefix.

Growing community of inventors

Jiangsu, China

Meng Hu