Amazon Technologies, Inc.

Bharathan Balaji

Leo Parker Dirac

Saurabh Gupta

Sunil Mallya Kasaragod

Sahika Genc

Vineet Khare

Eric Li Sun

Marthinus Coenraad De Clercq Wentzel

Gurumurthy Swaminathan

Ragav Venkatesan

Cameron Dean Whitehouse

Runfei Luo

Krzysztof Marcin Walczak

Urvashi Chowdhary

Karan Aggarwal

Sujan Kumar Gonugondla

Brian James Townsend

Siddhartha Agarwal

Pramod Ravikumar Kumar

Yijie Zhuang

Niranjini Rajagopal

Sahika Gene

Venkatesh Rao

Disclosed implementations determine transient distortions, amplitude distortions, and/or periodic distortions present in a voltage signal measured from an electrical circuit at a location and use those distortions to determine a device type of a device operating on the electrical circuit at the location. In some examples, the voltage signal may be filtered into a plurality of sub-bands and one or more two-dimensional representations generated based on transient distortions, amplitude distortions, and/or periodic distortions determined in each sub-band. The one or more 2D representations may be provided to a deep neural network to determine a device type that generated the distortions on the electrical circuit.

Device type detection

A simulation application container executes a simulation of a system in a simulation environment, through which an agent representing the system uses a reinforcement learning model to operate within the simulation environment. The simulation application container obtains data indicating how the agent performed in the simulation environment and transmits this data to a robot application container. The robot application container uses the data to update the reinforcement learning model and provides the updated reinforcement learning model to perform another iteration of the simulation and continue training the reinforcement learning model.

Simulation modeling exchange

A machine learning environment utilizing training data generated by customer networks. A reinforcement learning machine learning environment receives and processes training data generated by simulated hosted, or integrated, customer networks. The reinforcement learning machine learning environment corresponds to machine learning clusters that receive and process training data sets provided by the integrated customer networks. The customer networks include an agent process that collects training data and forwards the training data to the machine learning clusters. The machine learning clusters can be configured in a manner to automatically process the training data without requiring additional user inputs or controls to configure the application of the reinforcement learning machine learning processes.

Integrated machine learning training

A machine learning environment utilizing training data generated by customer environments. A reinforced learning machine learning environment receives and processes training data generated by independently hosted, or decoupled, customer environments. The reinforced learning machine learning environment corresponds to machine learning clusters that receive and process training data sets provided by the decoupled customer environments. The customer environments include an agent process that collects training data and forwards the training data to the machine learning clusters without exposing the customer environment. The machine learning clusters can be configured in a manner to automatically process the training data without requiring additional user inputs or controls to configured the application of the reinforced learning machine learning processes.

Decoupled machine learning training

A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.

Reinforcement learning model training through simulation

Techniques for iterative model training and deployment for automated learning systems are described. A method of iterative model training and deployment for automated learning systems comprises generating training data based on inference data, provided by a first version of a model hosted at an endpoint of a machine learning service, and feedback data, received from a client application, using an identifier associated with the inference data and the feedback data, generating a second version of the model using the training data, and deploying the model to the endpoint of the machine learning service.

Iterative model training and deployment for automated learning systems

A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.

Simulation orchestration for training reinforcement learning models

Growing community of inventors

Seattle, WA, United States of America

Bharathan Balaji