Microsoft Technology Licensing, LLC

Daniel Stefan Tarlow

Alexander Lloyd Gaunt

Matthew Alastair Johnson

Sebastian Nowozin

Samuel Alexander Webster

Marc Manuel Johannes Brockschmidt

Dimitrios Vytiniotis

Ryota Tomioka

Maik Riechert

Matej Balog

Jamie Daniel Joseph Shotton

Andrew William Fitzgibbon

Pushmeet Kohli

Toby Leonard Sharp

John Michael Winn

Thomas Joseph Cashman

Jonathan Taylor

Christopher Maddison

Seyed Mohammadali Eslami

David Joseph New Tan

Sameh Khamis

A neural network training apparatus is described which has a network of worker nodes each having a memory storing a subgraph of a neural network to be trained. The apparatus has a control node connected to the network of worker nodes. The control node is configured to send training data instances into the network to trigger parallelized message passing operations which implement a training algorithm which trains the neural network. At least some of the message passing operations asynchronously update parameters of individual subgraphs of the neural network at the individual worker nodes.

Asynchronous neural network training

A computer program predictor is described which has a processor configured to access a program attribute predictor; and a memory storing a search component configured to search a space of possible programs, to find a program which, given an input data instance and an output data instance, will compute the output data instance from the input data instance, the search being guided by attributes predicted by the attribute predictor given the input data instance and the output data instance.

Program predictor

An inference engine is described for efficient machine learning. For example, an inference engine executes a plurality of ordered steps to carry out inference on the basis of observed data. For each step, a plurality of inputs to the step are received. A predictor predicts an output of the step and computes uncertainty of the prediction. Either the predicted output or a known output is selected on the basis of the uncertainty. If the known output is selected, the known output is computed, (for example, using a resource intensive, accurate process). The predictor is retrained using the known output and the plurality of inputs of the step as training data. For example, computing the prediction is fast and efficient as compared with computing the known output.

Interface engine for efficient machine learning

Examples describe an apparatus for calibrating a three dimensional (3D) mesh model of an articulated object. The articulated object is an instance of a specified object class. The apparatus comprises an input configured to receive captured sensor data depicting the object. The apparatus has a calibration engine configured to compute values of shape parameters of the 3D mesh model which indicate which member of the object class is depicted in the captured sensor data, in order to calibrate the 3D mesh model. The calibration engine is configured to compute the values of the shape parameters with an optimization process to find at least one potential local or global minimum of an energy function, the energy function expressing a degree of similarity between data rendered from the model and the received sensor data.

Calibrating object shape

Automated generation, or completion, or checking of source code is described whereby a probabilistic model having been trained using a corpus of natural source code examples is used. In various examples the probabilistic model comprises probability distributions describing belief about structure of natural source code and takes into account source code analysis from a compiler or other source code analyzer. In various examples, source code analysis may comprise syntactic structure, type information and other data about source code. In various examples, the trained probabilistic model is used to predict sequences of source code elements. For example, to generate source code, to auto-complete source code, to error check source code, to error correct source code or for other purposes.

Source code generation, completion, checking, correction

Growing community of inventors

Cambridge, United Kingdom

Daniel Stefan Tarlow