Amazon Technologies, Inc.

Chase Kernan

James Christopher Sorenson

Akshat Vig

Somasundaram Perianayagam

Nicholas Gordon

Sharatkumar Nagesh Kuppahally

Vaibhav Jain

Ravi Math

Divyank Duvedi

Amit Gupta

Peter Zhivkov

Remi Paucher

Tate Andrew Certain

Conor Patrick Cahill

Dumanshu Goyal

Pejus Manoj Das

Alexander Richard Keyes

Oren Yossef

Go Hori

Hao He

Arijit Choudhury

Jeffrey John Wierer

Lewis Bruck

Sanjay Shanthakumar

Anurag Mishra

Sudhir Konduru

Akanksha Fouzdar

Richard Krog

Naveen Ganapathi Subramanian

Elie Gharios

Robert Kenny

Uma Ganesh Sadras Sudhakar

Mohammed Noman Mulla

A database management system obtains key ranges associated with partitions of a database table, and determines that restoration of data associated with at least one of these partitions would take time that is estimated to exceed a goal time. The database management system splits a partition into two or more additional partitions, so that the respective estimated restoration times for data associated with the additional partitions is estimated to be less than the goal time. The database management system then causes the database table to be restored according to partitions that comprises the additional partitions.

Database table restoration for data with skewed distribution

Offline building of a projected data subset may be performed. A request to create a data set that is a projected subset of data from a source data set may be received. A data store separate from the data store storing the source data set may store a copy of the source data set that is used to replicate items to the projected subset of data according to a schema for the projected data subset. Updates made to the source data set may also be replicated to the projected data subset according to the schema. Conflicts between replicated items and replicated updates to the projected data set may be resolved by comparing a version identifier for the replicated update and replicated item to determine what to store in the projected data subset.

Offline index builds for database tables

A system for database restoration across service regions. The system includes data storage and backup data storage in the first region. The system includes a frontend for the database service configured to receive, from a client, a request to restore a database to the first region from backups stored in another backup data storage in a second region and to receive an authentication token for the request from the client. The system also includes a backup restore manager service for the first region configured to send, to another backup restore manager service implemented in the second region, a credential request for a second region credential authorizing retrieval of the one or more other backups from the second region. The backup restore manager service sends a backup restore request to retrieve the backups from the other backup data storage and loads the backups to restore the database in the first region.

Secured database restoration across service regions

Replicas may be added to a multi-leader replica group for a data set. A new replica may be added to a group of replicas by copying a version of the data set according to a point in time to the new replica. As updates may occur at different ones of the replicas when the new replica is added, updates that occurred at a source replica for the snapshot and other replicas may be replicated by the different replicas according to the point in time at which the snapshot is created without blocking updates at any of the replicas in the replica group.

Adding replicas to a multi-leader replica group for a data set

Methods, systems, and computer-readable media for renaming a database table with minimized application downtime are disclosed. A database receives a table rename request for a table having a first table name. Routing metadata comprises a mapping of the first table name to a table identifier and a mapping of the table identifier to one or more partitions. The table rename request indicates a second table name. The database generates updated routing metadata responsive to the table rename request. The updated routing metadata comprises a mapping of the second table name to the table identifier and the mapping of the table identifier to the one or more partitions. The database receives, from a client application, one or more access requests indicating the second table name. The database routes the one or more access requests to the one or more partitions based at least in part on the updated routing metadata.

Renaming a database table with minimized application downtime

A system that implements a data storage system may store data for a database table in multiple replicated partitions on respective storage nodes. An export of an active database partition may generate an exported copy of the database partition. A first exported copy may be stored locally on a source node and a second exported copy of the database partition may be sent to a recipient node. The source node may validate the first copy responsive to sending the second copy and may perform the validation while the second copy is being sent and processed at the recipient node. If the first copy cannot be validated, the source node may cause the second copy to be invalidated and abort further processing of the second copy. The source node may also cause the second copy to be marked as invalid to prevent reliance on an invalid database partition copy.

Early detection of corrupt data partition exports

Various systems and methods to efficiently store backups of partitions of a database are disclosed. An indication to take a current snapshot of a partition of the database is received. A log size and operation type statistics are determined for a portion of the change log for the partition. A snapshot type is determined for the partition based at least in part on the log size and the operation type statistics, where the snapshot type specifies a log-based snapshot or a full snapshot. The snapshot is stored as metadata indicating a point in the change log if the determined snapshot type is log-based snapshot or stored as complete data of the partition if the determined snapshot type is full snapshot.

Efficient database snapshot generation

Growing community of inventors

Seattle, WA, United States of America

Chase Kernan