Amazon Technologies, Inc.

Jaykumar Patel

Arkady Michael Degtiarov

Daivat Bhatt

Hyong Hark Lee

Pari Jean Fariborz Garay

Anas Daboussi

Neil Patel

Osvaldo Vallejo Zamora

Yuchen Guo

Hasti Gheibi Dehnashi

Nishant Kanaiyalal Mehta

Keerthi Bala

Akshay Ganesh Nadkarni

Systems and methods are provided for replication sequencing and state management in a distributed storage system. A storage system may receive, from a remote storage system, a request to replicate first tag data for a data object replicated from the remote storage system to the storage system, wherein the first tag data is associated with a request sequence identifier; evaluate an object marker in object metadata for the data object, the object marker comprising an object marker sequence identifier associated with replication of second tag data previously stored for the data object; determine, based on an analysis of the request sequence identifier and the object marker sequence identifier, whether to replace the second tag data with the first tag data, wherein tag data replacement is prohibited if the object marker sequence identifier is after the request sequence identifier; and perform a storage operation associated with the data object.

Replication sequencing and state management in a distributed storage system

Systems and methods are provided for durable asynchronous replication in a distributed storage system. A storage system may commit a transaction comprising saving a data object to a persistent object storage location and saving a replication marker to a first persistent storage directory for pending replication tasks, wherein the replication marker comprises replication data for replicating the data object to a remote storage system, and wherein the first persistent storage directory comprises a replication queue; determine, based on a presence of the replication marker in the first persistent storage directory, to dequeue the replication marker from the replication queue; move the replication marker to a second persistent storage directory for in-process replication tasks; attempt replication of the data object to the remote storage system; and move the replication marker to a third persistent storage directory.

Durable asynchronous replication in a distributed storage system

Responsive to a configuration event, a controller instance generates, according to a current version of a configuration interface between the controller instance and a data instance, a configuration message. The configuration message is obtained, via message service, by remote data instances. The remote data instances attempt to process the configuration message, according to whichever version of the configuration interface the respective data instances are using. Appropriate acknowledgements (based on whether the remote data instances could fully process the configuration message or not) are generated and returned to the controller instance that marks a record for the configuration message as complete for the remote instance or marks the record for the configuration message to be re-sent for the remote instance. After waiting some period of time to allow data instances with out-of-date versions to update, a configuration message update cycle re-sends the message to the appropriate remote data instances.

Metadata synchronization for remote managed systems

Growing community of inventors

Cambridge, MA, United States of America

Jaykumar Patel