Amazon Technologies, Inc.

Jonathan Esterhazy

Hagay Lupesko

Sandeep Krishnamurthy

Vikram Madan

Roshani Nagmote

Yao Wang

Naveen Mysore Nagendra Swamy

Stefano Stefani

Thomas Albert Faulhaber, Jr

Vladimir Zhukov

Dominic Rajeev Divakaruni

Jiajie Chen

Ruofei Yu

Methods and apparatus for providing persistent execution environments for computation systems including but not limited to interactive computation systems. A service is provided that extends the notion of static containers to dynamically changing execution environments into which users can install code, add files, etc. The execution environments are monitored, and changes to an execution environment are automatically persisted to environment versions(s) so that code run in the execution environment can be run later or elsewhere simply by referring to the environment. There is no explicit build step for the user. Instead, incremental changes are added to environment versions which are stored and are ready to be used to instantiate respective execution environments on other compute instances.

Persistent execution environment

Techniques for model adaptation are described. For example, a method of receiving a call to provide either a model variant or a model variant profile of a deep learning model, the call including desired performance of the deep learning model, a deep learning model identifier, and current edge device characteristics; comparing the received current edge device characteristics to available model variants and profiles based on the desired performance of the deep learning model to generate or select a model variant or profile, the available model variants and profiles determined by the model identifier; and sending the generated or selected model variant or profile to the edge device to use in inference is detailed.

Model adaptation

Techniques for benchmarking a machine learning model/algorithm are described. For example, in some instances a method includes generating an execution plan for benchmarking of at least one task corresponding to a machine learning model based on an identified machine learning model, identified training data, and at least one objective for the benchmarking job; receiving execution statistics about the execution of the task as a part of the benchmarking job according to the execution plan; and updating the execution plan based at least in part on the received execution statistics of the task.

Benchmarking machine learning models via performance feedback

Growing community of inventors

Alameda, CA, United States of America

Jonathan Esterhazy