Amazon Technologies, Inc.

Aaron Graydon Bannert

Ethan Joseph Torretta

Schuyler David Thompson

Jose De Jesus Camacho Ruiz

Gowtham Kumar Puligundla

Nitish Goyal

A network connection is established between a client program and a particular request handler of a network-accessible service. The request handler is selected by a load balancer using an algorithm whose input includes configuration information of the service. The load balancer does not store flow state information for messages transmitted via the network connection. A networking manager of a host at which the client program runs stores the flow state information, including identification information of the particular request handler. Using the identification information, the networking manager causes additional messages directed to the service from the client program to be received at the particular request handler without using the load balancer as an intermediary.

Low-latency stateful load-balanced connections using stateless load balancers

A network function execution intermediary obtains a result of execution of a set of network functions on a particular packet directed to a service from a client program running at a first host. Using the result, the packet is delivered to a request handler of the service, running at a second host; the path used for delivering the particular packet includes the network function execution intermediary. A networking manager of the first host obtains a rule for determining results of the set of network functions with respect to additional packets directed from the client program to the service. The networking manager causes, using the rule, another packet originating at the client program to be delivered to the request handler via a different path which does not include the network function execution intermediary.

Low-latency paths for data transfers between endpoints which utilize intermediaries for connectivity establishment

Techniques for load balancing based on relative credit balances are described. For example, one embodiment of a method comprises: determining current credit balances for a plurality of compute instances; receiving a request; selecting one of the compute instances to be a destination for the request based on a comparison of the current credit balances; and transmitting the request to the selected compute instance.

Growing community of inventors

Seattle, WA, United States of America

Aaron Graydon Bannert