Amazon Technologies, Inc.

James Larson

Robert Wai-Chi Chu

James R Collette

Partha Saha

Patrick W Ransil

Aleksey Martynov

Method and apparatus for stress management in a searchable data service. The searchable data service may provide a searchable index to a backend data store, and an interface to build and query the searchable index, that enables client applications to search for and retrieve locators for stored entities in the backend data store. Embodiments of the searchable data service may implement a distributed stress management mechanism that may provide functionality including, but not limited to, the automated monitoring of critical resources, analysis of resource usage, and decisions on and performance of actions to keep resource usage within comfort zones. In one embodiment, in response to usage of a particular resource being detected as out of the comfort zone on a node, an action may be performed to transfer at least part of the resource usage for the local resource to another node that provides a similar resource.

Method and apparatus for stress management in a searchable data service

Method and apparatus for monitoring and maintaining group health and membership in a searchable data service. The searchable data service may provide a searchable index to a backend data store, and an interface to build and query the searchable index, that enables client applications to search for and retrieve locators for stored entities in the backend data store. Embodiments of the searchable data service may implement a group health mechanism that may allow one or more components of the searchable data service to identify sets of nodes that the components may monitor. A group health component may be queried by the other components for automatically-refreshed health information about those nodes. The group health component may perform as a node failure detection mechanism. Node health information may be communicated among nodes at least in part using a gossip protocol.

Method and apparatus for monitoring and maintaining health in a searchable data service

Method and apparatus for a searchable data service are described. The searchable data service may be implemented as a Web service with a Web service interface that allows the storage of locators and other attributes associated with entities stored in a data store in a searchable index. The attributes may be expressed as {name, value} pairs. The interface may allow client applications to query the searchable index to retrieve locators for entities in the backend data store according to the attributes associated with each locator. Search speed may be automatically optimized using, for example, indexes, query planning, and parallelism. The searchable data service provides a searchable index and is not a data store per se. The searchable data service separates searching and indexing of data from the actual storage of the data.

Method and apparatus for a searchable data service

Method and apparatus for repartitioning and replication of a searchable index in a searchable data service. The searchable data service may provide a searchable index to a backend data store. The searchable index may be repartitioned, and a partition may be moved to another storage node, to allow the searchable index to grow beyond the limits of a single storage device. Repartitioning may also be performed to provide load-balancing of write requests. Partitions may be replicated across two or more storage nodes to provide redundancy, data durability, data availability and load balancing of read requests among the storage nodes and/or across data centers. In one embodiment, a lazy replication mechanism may be used in the replication of partitions. In one embodiment, replication may be performed using an anti-entropy protocol to replicate a partition, and a gossip protocol to update the replicated partition.

Growing community of inventors

Dublin, CA, United States of America

James Larson