Amazon Technologies, Inc.

Bryan T Wilkinson

Sameer Choudhary

Nikhil Shah

Vishwas Narendra

Phillip H Pruett, Iv

James Zuber

Tyler Michael Jung

Ernest S Cohen

Arvinth Ravi

Prathiban Mohanasundaram

Hardik Navin Nagda

Nishant Jain

Janko Jerinic

Vijayasarathy Kannan

Nicholas Jacob Essenburg

Slavcho Georgiev Slavchev

Liming Ye

Rajesh Sampath

Suchindra Yogendra Agarwal

Abhishek Kannan

Pierre Vigneras

David Grant Emeny-Smith

Wilson Li

Tianxing Dun

Ozan Okumusoglu

Alexander Koshelev

Systems and methods are provided for using request rate data to determine when and how to split storage partitions in a distributed storage system. Data objects in a given partition are stored and managed using a set of computing resources, such as caches, a witness service, and persistent storage nodes. When the request rate for the partition is too great, then the partition may be split in order to distribute the request load over two sets of computing resources. Some requests that would be able to be handled by the cache are passed through to the persistent storage nodes, which can track the requests at a granular level. Based on this data, specific partition splitting decisions can be made.

Data item and witness service partitioning in a distributed storage system

Systems and methods are provided for efficiently maintaining a transaction sequence witness service to ensure that requests to read data provide consistent results across all storage nodes in a distributed system. Each storage node that stores data in response to a particular update event may first update the transaction sequence witness service with the sequence number for the update event. Thus, any other storage node that services a subsequent request for the data will be able to see, via the transaction sequence witness service, the sequence number that must be available on the storage node to respond to the request.

Data event management for monotonic read consistency in a distributed storage system

Systems and methods are provided for efficiently maintaining a transaction sequence witness service to ensure that requests to read data provide consistent results across all storage nodes in a distributed system. When a storage node receives a request for a data object, the node may obtain&#x2014;from transaction sequence witness service&#x2014;the latest sequence number associated with the object. If the sequence number indicates the object has been modified in the period of time since the currently stored version was stored, the node can obtain the current version from persistent storage.

Witness service for ensuring data consistency in a distributed storage system

Growing community of inventors

Seattle, WA, United States of America

Bryan T Wilkinson