Amazon Technologies, Inc.

Sheikh Naveed Zafar

Nitin Kesarwani

Robert Mark Waugh

Emmanuel Pierre Devillard

Daniel Vassallo

Hongqi Wang

Greg Sterin

Fault tolerant data export is provided through the checkpointing of various export tasks. Data entries, such as event log records, to be exported are assigned to a set of discrete export tasks. A snapshot of the data can be taken to indicate the state of the data to be exported. The tasks can be performed using appropriate resources, and for each task that completes successfully an entry can be made in a checkpoint data file or a virtual cursor can be updated for the snapshot indicating completion of that task. In the event of a failure of one or more tasks, a workflow manager or other such component can determine which tasks failed using the checkpointing data and retry only those specific tasks, without having to retry the entire export.

Fault tolerant data export using snapshots

A technology is provided for enabling a partitioned search to be performed on log events from multiple log streams that are stored by multiple hosts. A search query may be submitted to identify the log streams whose log events are to be searched and to indicate a time interval in which log events are to have occurred as indicated by the log events' time stamps. The multiple hosts may search stored log events in parallel and return a set of log-event search results satisfying the search query. A pagination token can be included with the set of log event search results. The pagination token may be used to resume the search if the multiple hosts were not able to completely finish searching the stored log events before the set of log-event search results had to be returned to prevent a timeout of a search client.

Partitioned search of log events

Growing community of inventors

Lynwood, WA, United States of America

Sheikh Naveed Zafar