Amazon Technologies, Inc.

Other

Umesh Chandani

Malcolm Featonby

John Merrill Phillips

Douglas Cotton Kurtz

Adithya Bhat

Mihir Sadruddin Surani

Yuxuan Liu

Leslie Johann Lamprecht

Letian Feng

Roberto Pentz De Faria

Ladan Mahabadi

Hou Liu

Nicholas Patrick Wilt

Joseph Elmar Magerramov

Cristian Gabriel Gafton

Paolo Maggi

Andrea Curtoni

Jr John Merrill Phillips

Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

Compute platform recommendations for new workloads in a distributed computing environment

Compute platform optimization over the life of a workload in a distributed computing environment

A graphic session coordinator is established to enable remote virtualized graphics operations on behalf of a set of graphics request generators. A request generator submits a graphics session request to the session coordinator. A configuration operation is performed at one or more routing devices to enable graphics operation request packets from the request generator to be delivered to a first remote virtualized graphics device and to enable graphics operation response packets to be transmitted to a destination.

Session coordination for auto-scaled virtualized graphics processing

Determining configuration parameters to provide recommendations for optimizing workloads

Techniques for an optimization service of a service provider network to provide users with machine-generated narratives that include human-intelligible, credible, and transparent recommendations and rationales for recommended VM instance types. The optimization service may gather various information or data about the workload, such as utilization characteristics of the underlying computing resources, and decompose the workloads through a number of dimensions that can be used to describe the workload. Further, the optimization service may analyze the utilization characteristics and/or other data to determine more optimized VM instance types for the workloads that are to be recommended to the users, and also rationales that describes why each recommendation is an appropriate fit for the workload being assessed. Using this information, the optimization service may generate narratives that include a description of the workload behaviors and utilization patterns, a set of recommendations, and supporting narrative or rationales for each of the recommendations.

Generating narratives for optimized compute platforms

Compute platform optimization across heterogeneous hardware in a distributed computing environment

Optimizing hardware platform utilization for heterogeneous workloads in a distributed computing environment

Techniques for providing a managed time service are described. A control plane of the managed time service can receive data indicating one or more network time protocol (NTP) hosts are active. The control plane can update a zonal domain name system (DNS) to include the one or more NTP hosts. The at least one compute resource accesses the one or more NTP hosts using the zonal DNS, and the one or more NTP hosts provide time data to the at least one compute resource. The control plane can receive performance data from the one or more NTP hosts and automatically scale the one or more NTP hosts based on the performance data.

Managed time service for compute resources

Methods, systems, and computer-readable media for interaction monitoring for virtualized graphics processing are disclosed. Execution of an application is initiated on a virtual compute instance that is implemented using CPU and memory resources of a server. Instruction calls are produced by the execution of the application and sent from the server to a graphics server over a network. The graphics server comprises a physical GPU, and a virtual GPU is implemented using the physical GPU and attached to the virtual compute instance. GPU output is generated at the graphics server based at least in part on execution of the instruction calls using the virtual GPU. A log of interactions between the application and the virtual GPU is stored. The interactions comprise the instruction calls sent to the graphics server and responses to the instruction calls sent to the virtual compute instance.

Interaction monitoring for virtualized graphics processing

Methods, systems, and computer-readable media for capacity reservation for virtualized graphics processing are disclosed. A request is received to attach a virtual GPU to a virtual compute instance. The request comprises one or more constraints. Availability information is retrieved from a data store that indicates virtual GPUs available in a provider network and matching the one or more constraints. A virtual GPU is selected from among the available virtual GPUs in the availability information. The selected virtual GPU is reserved for attachment to the virtual compute instance. The virtual compute instance is implemented using CPU resources and memory resources of a physical compute instance, the virtual GPU is implemented using a physical GPU in the provider network, and the physical GPU is accessible to the physical compute instance over a network.

Capacity reservation for virtualized graphics processing

A first remote virtualized graphics device is instantiated in response to a determination that processing of graphics operations is to be enabled in a first availability mode on behalf of a compute instance. A configuration operation is performed at a routing device to enable packets from the first remote virtualized graphics device to be transmitted to a graphics result destination. In response to an indication of unavailability, the routing device is configured to enable packets from a second remote virtualized graphics device to be directed to the graphics result destination.

Availability modes for virtualized graphics processing

Methods, systems, and computer-readable media for dynamic and application-specific virtualized graphics processing are disclosed. Execution of an application is initiated on a virtual compute instance. The virtual compute instance is implemented using a server. One or more graphics processing unit (GPU) requirements associated with the execution of the application are determined. A physical GPU resource is selected from a pool of available physical GPU resources based at least in part on the one or more GPU requirements. A virtual GPU is attached to the virtual compute instance based at least in part on initiation of the execution of the application. The virtual GPU is implemented using the physical GPU resource selected from the pool and accessible to the server over a network.

Dynamic and application-specific virtualized graphics processing

A determination is made that network access between a virtualized graphics device and a compute instance of a client is to be enabled. A source network address for graphics-related traffic of the compute instance is identified. From a range of source port numbers associated with the source network address, a particular source port number which is unused is found. Routing metadata is transmitted to one or more routing devices indicating that a key based at least in part on (a) the source network address and (b) the particular source port number is to be used to identify a route for network packets from the first application compute instance to a virtualized graphics device.

Growing community of inventors

Seattle, WA, United States of America

Umesh Chandani