Amazon Technologies, Inc.

Oscar Ricardo Moll Thomae

Samuel James McKelvie

Yan Valerie Leshinsky

Pradeep Jnana Madhavarapu

James McClellan Corey

Anurag Windlass Gupta

Christopher Richard Newcombe

Benjamin Tobler

A log-structured data store may implement efficient garbage collection. Log records may be maintained in data blocks according to a log record sequence. Based, at least in part, on a log reclamation point, the log records may be evaluated to identify data blocks to reclaim that have log records in the log sequence prior to the log reclamation point. New versions of data pages updated by log records in the identified data blocks may be generated and stored in base page storage for the log structured data store. The identified data blocks may then be reclaimed for storing new data.

Efficient garbage collection for a log-structured data store

A log-structured distributed storage system may implement individual write quorums. Log records may be sent to different storage nodes of a quorum set storing data for a storage client sufficient to satisfy a write quorum requirement. For each log record, acknowledgments from storage nodes are received, and a determination is made whether the write quorum requirement is satisfied for the log record. Different log records may be maintained at different storage nodes, and still satisfy the write quorum requirement such that in some embodiments no one storage node may maintain all of the log records sent to storage nodes in the quorum set.

Individual write quorums for a log-structured distributed storage system

Growing community of inventors

Seattle, WA, United States of America

Oscar Ricardo Moll Thomae