Amazon Technologies, Inc.

Carnegie Mellon University

Sunil Mallya Kasaragod

Yahor Pushkin

Sahika Genc

Calvin Yue-Ren Kuo

Leo Parker Dirac

Sravan Babu Bodapati

Yaser Al-Onaizan

Aran Khanna

Bharathan Balaji

Tao Sun

Miguel Ballesteros Martinez

Abhinav Goyal

Graham Vintcent Horwood

Sameer Karnik

Yunzhe Tao

Saurabh Gupta

Rishita Rajal Anubhai

Yogarshi Paritosh Vyas

Yinxiao Zhang

Ravindra Manjunatha

Eric Li Sun

Srikanth Doss Kadarundalagi Raghura

Marthinus Coenraad De Clercq Wentzel

Yusheng Xie

Vineet Khare

Nagajyothi Nookula

Saman Zarandioon

Mark Desnoyer

Deborah Jeanne Johnson

Ambika Pajjuri

Richard Lee

Kalpit Dixit

Syed Kashif Hussain Shah

Urvashi Chowdhary

Kasturi Bhattacharjee

Shuai Wang

Sophie Lebrecht

Rahul Suresh

Bo Pang

Kapil Singh Badesara

Smaranda Muresan

Jie Ma

Michael Jay Tarr

Aruni Roy Chowdhury

Liutong Zhou

Sahika Gene

Xuan Zhu

Diego Marcheggiani

Alok Kumar Parmesh

Alessandra Brusadin

Jonathan Steuck

Federico Torreti

Brian James Townsend

Hsin Chieh Chen

Siddharth Chaitanyakumar Varia

Pramod Ravikumar Kumar

Kaiqing Zhang

A simulation application container executes a simulation of a system in a simulation environment, through which an agent representing the system uses a reinforcement learning model to operate within the simulation environment. The simulation application container obtains data indicating how the agent performed in the simulation environment and transmits this data to a robot application container. The robot application container uses the data to update the reinforcement learning model and provides the updated reinforcement learning model to perform another iteration of the simulation and continue training the reinforcement learning model.

Simulation modeling exchange

Methods, systems, and computer-readable media for context-sensitive linking of entities to private databases are disclosed. An entity linking service stores a plurality of representations of entities. Individual ones of the entities correspond to individual ones of a plurality of records in one or more private databases. The entity linking service determines a mention of an entity in a document. The entity linking service selects, from the plurality of records in the one or more private databases, a record corresponding to the entity. The record is selected based at least in part on the plurality of representations of the entities and based at least in part on a context of the mention of the entity in the document. The entity linking service generates output comprising a reference to the selected record in the one or more private databases.

Context-sensitive linking of entities to private databases

Techniques for utilizing a federated learning service are described. An exemplary method includes causing a development of a deployable machine learning model using at least two devices, the development of the deployable machine learning model including: providing an initial machine learning model or algorithm to the at least two devices external to the provider network, causing each of the at least two devices external to the provider network to locally train the initial machine learning model or algorithm using training data to each generate a modified version of the initial machine learning model, determining updates between the initial model and the generated modified versions of the initial machine learning model, and applying the determined updates to the initial model to generate the candidate machine learning model.

Federated learning service in a provider network and training machine learning models using devices external to the provider network

Techniques for robust multi-agent reinforcement learning (MARL) are described. An exemplary method includes initializing a plurality of parameters for a plurality of agents including at least policy parameters and action-value (Q) parameters; performing robust multi-agent reinforcement learning to learn polices for the agents, wherein in the learned polices no agent has an incentive to deviate, the agents include an implicit agent that is to select a worst-case at any given time during the learning process; and at least one agent utilizing its learned policy.

Robust multi-agent reinforcement learning

A global segmenting and analysis service of a provider network may receive documents (e.g., posts, product reviews) from different applications. The service may analyze the documents to identify target entities and sentiment. The service may generate different levels of sentiment data and store data into a segmented database. For example, the service may store within-document level sentiment, document-level sentiment, and multi-document level sentiment for a target entity. The service may also update the entity taxonomy automatically or with only a small number of sample documents. The client may query the service for the segmented sentiment data.

Global segmenting and sentiment analysis based on granular opinion detection

A machine learning environment utilizing training data generated by customer networks. A reinforcement learning machine learning environment receives and processes training data generated by simulated hosted, or integrated, customer networks. The reinforcement learning machine learning environment corresponds to machine learning clusters that receive and process training data sets provided by the integrated customer networks. The customer networks include an agent process that collects training data and forwards the training data to the machine learning clusters. The machine learning clusters can be configured in a manner to automatically process the training data without requiring additional user inputs or controls to configure the application of the reinforcement learning machine learning processes.

Integrated machine learning training

Methods, systems, and computer-readable media for event extraction from documents with co-reference are disclosed. An event extraction service identifies one or more trigger groups in a document comprising text. An individual one of the trigger groups comprises one or more textual references to an occurrence of an event. The one or more trigger groups are associated with one or more semantic roles for entities. The event extraction service identifies one or more entity groups in the document. An individual one of the entity groups comprises one or more textual references to a real-world object. The event extraction service assigns one or more of the entity groups to one or more of the semantic roles. The event extraction service generates an output indicating the one or more trigger groups and one or more entity groups assigned to the semantic roles.

Event extraction from documents with co-reference

A training system may create and train a machine learning model with knowledge transfer. The knowledge transfer may transfer knowledge that is acquired by another machine learning model that has been previously trained to the machine learning model that is under training. The knowledge transfer may include a combination of representation transfer and instance transfer, the two of which may be performed alternatingly. The instance transfer may further include a filter mechanism to selectively identify instances with a satisfactory performance to implement the knowledge transfer.

Systems and methods for knowledge transfer in machine learning

A data source configured to provide a representation of an environment of one or more agents is identified. Using a data set obtained from the data source, a neural network-based reinforcement learning model with one or more attention layers is trained. Importance indicators generated by the attention layers are used to identify actions to be initiated by an agent. A trained version of the model is stored.

Attention-based deep reinforcement learning for autonomous agents

Edge devices of a network collect data. An edge device may determine whether to process the data using a local data processing model or to send the data to a tier device. The tier device may receive the data from the edge device and determine whether to process the data using a higher tier data processing model of the tier device. If the tier device determines to process the data, then the tier device processes the data using the higher tier data processing model, generates a result based on the processing, and sends the result to an endpoint (e.g., back to the edge device, to another tier device, or to a control device). If the tier device determines not to process the data, then the tier device may send the data on to another tier device for processing by another higher tier model.

Model tiering for IoT device clusters

Various embodiments of a hierarchical system or method of identifying sensitive content in data is described. In some embodiments, sensitive data classifiers local to a data storage system can analyze a plurality of data items and classify at least some data items as potentially containing sensitive data. The sensitive data classifiers can provide the classified data items to a separate sensitive data discovery component. The sensitive data discovery component can, in some embodiments, obtain the classified data items, perform a sensitive data location analysis on the classified data items to identify a location of sensitive data within some of the classified data items, and generate location information for the sensitive data within the data items containing sensitive data. The sensitive data discovery component can provide to a destination this information, in some embodiments, where the destination might redact, tokenize, highlight, or perform other actions on the located sensitive data.

Hierarchical system and method for identifying sensitive content in data

Techniques for performing natural language processing (NLP) on semi-structured data are described. An exemplary method includes receiving a semi-structured document to perform NLP on using a trained NLP model; converting the semi-structured document into a secondary format, wherein the secondary format includes spatial information for tokens of the semi-structured document; flattening the converted, secondary formatted semi-structured document into a Unicode Transformation Format text file; performing NLP on the Unicode Transformation Format text file using the trained NLP model; and providing a result of the NLP to a requester.

Natural language processing on semi-structured data

A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.

Reinforcement learning model training through simulation

Growing community of inventors

San Francisco, CA, United States of America

Sunil Mallya Kasaragod