Amazon Technologies, Inc.

Ankit Khedia

Hagay Lupesko

Sandeep Krishnamurthy

Roshani Nagmote

Lai Wei

Kalyanee Shriram Chendke

Vandana Kannan

Anirudh Acharya

Cheng-Che Lee

Lee Cheng-Che

Techniques are described automatically determining runtime configurations used to execute recurrent neural networks (RNNs) for training or inference. One such configuration involves determining whether to execute an RNN in a looped, or 'rolled,' execution pattern or in a non-looped, or 'unrolled,' execution pattern. Execution of an RNN using a rolled execution pattern generally consumes less memory resources than execution using an unrolled execution pattern, whereas execution of an RNN using an unrolled execution pattern typically executes faster. The configuration choice thus involves a time-memory tradeoff that can significantly affect the performance of the RNN execution. This determination is made automatically by a machine learning (ML) runtime by analyzing various factors such as, for example, a type of RNN being executed, the network structure of the RNN, characteristics of the input data to the RNN, an amount of computing resources available, and so forth.

Automatically determining configurations for executing recurrent neural networks

Features related to systems and methods for automated generation of a machine learning model based in part on a pretrained model are described. The pretrained model is used as a starting point to augment and retrain according to client specifications. The identification of an appropriate pretrained model is based on the client specifications such as model inputs, model outputs, and similarities between the data used to train the models.

Machine learning services with pre-trained models

Growing community of inventors

Redwood City, CA, United States of America

Ankit Khedia