Microsoft Technology Licensing, LLC

Sebastian Tschiatschek

Cheng Zhang

Yingzhen Li

Reinhard Sebastian Bernhard Nowozin

Anja Thieme

Olga Ohrimenko

Katja Hofmann

Sam Michael Devlin

Jose Miguel Hernandez Lobato

Kamil Andrzej Ciosek

Shruti Shrikant Tople

Ameera Patel

Iain Edward Buchan

Maximilian Igl

Richard Eric Turner

Danielle Charlotte Mary Belgrave

Konstantina Palla

Chao Ma

Pashmina Cameron

Camilla Alice Longden

Wenbo Gong

José Miguel Hernández Lobato

Angus Lamb

Evgeny Sergeevich Saveliev

Jose Miguel Hernández Lobato

An apparatus has a memory storing a reinforcement learning policy with an optimization component and a data collection component. The apparatus has a regularization component which applies regularization selectively between the optimization component of the reinforcement learning policy and the data collection component of the reinforcement learning policy. A processor carries out a reinforcement learning process by: triggering execution of an agent according to the policy and with respect to a first task; observing values of variables comprising: an observation space of the agent, an action of the agent; and updating the policy using reinforcement learning according to the observed values and taking into account the regularization.

Behavior policy for a generalized reinforcement learning agent utilizing a weight of a loss function

A method of selecting data for privacy preserving machine learning comprises: storing training data from a first party, storing a machine learning model, and storing criteria from the first party or from another party. The method comprises filtering the training data to select a first part of the training data to be used to train the machine learning model and select a second part of the training data. The selecting is done by computing a measure, using the criteria, of the contribution of the data to the performance of the machine learning model.

Privacy enhanced machine learning

A computer-implemented method of training an auxiliary machine learning model to predict a set of new parameters of a primary machine learning model, wherein the primary model is configured to transform from an observed subset of a set of real-world features to a predicted version of the set of real-world features.

Auxiliary model for predicting new model parameters

A method of training a model comprising a generative network mapping a latent vector to a feature vector, wherein weights in the generative network are modelled as probabilistic distributions. The method comprises: a) obtaining one or more observed data points, each comprising an incomplete observation of the features in the feature vector; b) training the model based on the observed data points to learn values of the weights of the generative network which map the latent vector to the feature vector; c) from amongst a plurality of potential next features to observe, searching for a target feature of the feature vector which maximizes a measure of expected reduction in uncertainty in a distribution of said weights of the generative network given the observed data points so far; and d) outputting a request to collect a target data point comprising at least the target feature.

Collecting observations for machine learning

A computer-implemented method comprising: outputting questions to a user via one or more user devices, and receiving back responses to some of the questions from the user via one or more user devices; over time, controlling the outputting of the questions so as to output the questions under circumstances of different values for each of one or more items of metadata, wherein the one or more items of metadata comprise one or more physical conditions of the user; monitoring whether or not the user responds when the question is output with the different metadata values; training the machine learning algorithm to learn a value of each of the items of metadata which optimizes a reward function, and based thereon selecting a circumstance when the user is exhibiting a particular physical condition to output subsequent questions.

Gathering data in a communication system

A computer-implemented method comprising: outputting questions to a user via one or more user devices, and receiving back responses to some of the questions from the user via one or more user devices; over time, controlling the outputting of the questions so as to output the questions under circumstances of different values for each of one or more items of metadata, wherein the one or more items of metadata comprise at least a time and/or a location at which a question was output to the user via the one or more user devices; monitoring whether or not the user responds when the question is output with the different metadata values; training the machine learning algorithm to learn a value of each of the items of metadata which optimizes a reward function, and based thereon selecting a time and/or location at which to output subsequent questions.

Generalized reinforcement learning agent

Growing community of inventors

Cambridge, United Kingdom

Sebastian Tschiatschek