Amazon Technologies, Inc.

Timothy Allen Gilman

David Y Yamanoha

Brady Montz

Joel Ross Ohman

Eugene Sheung Chee Lam

Dipanwita Sarkar

Pradeep Vincent

Mukul Vijay Karnik

Vishal Parakh

Antoun Joubran Kanawati

Houman Hassani Jalilian

Taras Alenin

Processes and systems are disclosed for selecting a producer system from a number of producer systems to lease to a consumer system. A leasing agent, in response to a request from the consumer system for access to a service at a producer system, can identify a producer system to lease to the lease requestor based, at least in part, on a selection weight associated with each producer system that the leasing agent is assigned. The selection weights can be modified based on status information associated with each of the producer systems. This status information may be obtain from the producer systems and/or from a consumer system that has previously accessed the producer system. The consumer system may provide the status information to the leasing agent as part of the consumer system's lease request.

Producer system registration

One or more multi-service network traffic controllers are established for a distributed system. The controllers are connected to traffic control implementation units at a first service and a second service. Based at least in part on data collected from a traffic control implementation unit deployed at the second service, a modification to be made to a parameter of a traffic control implementation unit deployed at the first service is determined at the controllers. The modification is applied at the first service, and results in a change to a traffic flow of the second service.

Unified network traffic controllers for multi-service environments

Technologies are disclosed for local and distributed function based dynamic traffic management for network services. A service host executes a network service and provides a service framework that includes one or more handlers. When a request is received for the service, one of the handlers assigns a classification to the request. The handler then provides the classification to a dynamic function based traffic controller. The controller determines whether the network service is to process the request based on the classification of the request, metrics associated with the network service, and a local traffic management policy. If the controller determines that the network service is not to process the request, the request is rejected. Otherwise, the request is passed to the network service for processing. Metrics can also be provided from the service host to a distributed performance monitoring system for use in managing network traffic at a fleet level.

Function based dynamic traffic management for network services

Producer system selection

Growing community of inventors

Sumner, WA, United States of America

Timothy Allen Gilman