Amazon Technologies, Inc.

Xetdata Inc.

Rajat Arya

Shyam Krishnamoorthy

Rajaprabhu Thiruchi Loganathan

Nishanth Shankaran

Clint Joseph Sbisa

Dong Shou

Yucheng Low

Ajit Banerjee

Shyam Kirshnamoorthy

In some aspects, a computing system may generate a content-defined tree. A content-defined tree may be a tree of cryptographic hashes where each leaf is a hash of a chunk (e.g., data chunk) of a data object, and each parent node (e.g., interior node) is the hash of a concatenation of the hashes of the parent's children nodes. To create parent nodes for the leaf nodes, a computing system may group leaf nodes together based on a rolling hash (e.g., a rolling hash of the hashes of the leaf nodes) satisfying a condition. Each parent node may include a hash that represents the concatenation of the hashes of the leaf nodes that fall under the corresponding parent node.

Cross-silo data storage and deduplication

Data indexing and deduplication using content-defined trees

A cache or other cluster is configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated for use by a client. A client may use a client driver as an intermediary that is responsible for managing the communication with the cluster. For example, a client driver may resolve an alias from a static configuration endpoint to a storage node. The client driver may request an initial configuration from the storage node and then update configuration from one or more storage nodes that store current configuration of the cluster.

Distributed caching cluster client configuration

A management system may enable and monitor a cache or other cluster to make the cluster configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated. For example, a distributed memory caching system may provide initial configuration to a client from a memory caching node referenced by an alias provided by a configuration endpoint. Updates of configuration may be retrieved from memory caching nodes, each storing current configuration of the cache cluster. A management system monitors changes to the cache cluster, such as provisioning of new caching nodes, and updates the configuration stored in the caching nodes for retrieval by a client.

Distributed caching cluster management

A cache or other cluster is configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated. For example, a client may resolve an alias from a static configuration endpoint to a node in a cluster. The client may request initial configuration from the node and then update configuration from nodes that store the current configuration of the cluster.

Distributed caching cluster configuration

A cache cluster is configuration-aware such that client initialization, access to replicated cached data and changes to the underlying structure of the cache cluster can be dynamically updated. For example, a management system monitoring a cache cluster notices a large number of requests for a key that causes a significant load on a first memory caching node. To reduce the load on the first memory caching node, the management system may cause cached data related to the key to be replicated to a second memory caching node. A configuration stored in one or more of the memory caching nodes may be updated by the management system to allow both memory caching nodes to serve the requests for the key to clients.

Growing community of inventors

Seattle, WA, United States of America

Rajat Arya