Amazon Technologies, Inc.

Nalin Goel

Harvo Reyzell Jones

Jason Messer

A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. A global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve first byte latency experienced by clients that leverage the data throughput resources of the private network.

Managing data throughput in a distributed endpoint network

A system and method for endpoint selection in a global accelerator system. The global accelerator system includes client devices communicating with a global access point to access various endpoints that can host services. Multiple endpoints are grouped geographically according to different data centers. Client service requests are received at a global access point, which in turns selects an endpoint to service the request. A selection mechanism utilized by the global access point implements a distribution algorithm that facilitates that distribution of endpoint requests according to a product of distribution criteria and geographic criteria. Additionally, the global access point can then identify individual endpoints within the group to process the request using a consistent hashing algorithm that ensures an endpoint can be continuously selected over the course of interaction with a client.

Load balanced access to distributed endpoints

A system and method for endpoint selection in a global accelerator system. The global accelerator system includes client devices communicating with a global access point to access various endpoints that can host services. The access points may calculate ranked lists of the plurality of endpoints based on a selection algorithm for the access points and select, for each access point, one of the plurality of endpoints based on the ranked lists before routing the received packets to the selected endpoints by each respective access point.

Systems and methods for avoiding duplicate endpoint distribution

A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. The global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve latency experienced by clients. Additionally, each TCP connection can be managed by specifying different congestion control and windowing parameters to leverage higher throughput between the global access point and a selected endpoint.

A system and method for management of communications for components in a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. To facilitate exchanges on behalf of different client devices, the global access points can characterize groupings of endpoints into subgroups or braids. Individual braid communications can be encapsulated and are routed at the data center by a networking equipment using 5-tuple information in packets. The components within individual braids can broadcast or multi-cast state information via management messages to ensure failover or mitigate duplicative processing.

Growing community of inventors

Seattle, WA, United States of America

Nalin Goel