Microsoft Technology Licensing, LLC

Joaquin Quinonero Candela

Ralf Herbrich

Thomas Ivan Borchert

Weizhu Chen

Thore Graepel

Thore Kurt Hartwig Graepel

Edward Lloyd Snelson

Taha Bekir Eren

Olliver Michael Christian Williams

Oleg Isakov

Jeffrey Scott Dunn

Methods, systems, and media are provided for a dynamic batch strategy utilized in parallelization of online learning algorithms. The dynamic batch strategy provides a merge function on the basis of a threshold level difference between the original model state and an updated model state, rather than according to a constant or pre-determined batch size. The merging includes reading a batch of incoming streaming data, retrieving any missing model beliefs from partner processors, and training on the batch of incoming streaming data. The steps of reading, retrieving, and training are repeated until the measured difference in states exceeds a set threshold level. The measured differences which exceed the threshold level are merged for each of the plurality of processors according to attributes. The merged differences which exceed the threshold level are combined with the original partial model states to obtain an updated global model state.

Parallelization of online learning algorithms

Event prediction in dynamic environments is described. In an embodiment a prediction engine may use the learnt information to predict events in order to control a system such as for internet advertising, email filtering, fraud detection or other applications. In an example one or more variables exists for pre-specified features describing or associated with events and each variable is considered to have an associated weight and time stamp. For example, belief about each weight is represented using a probability distribution and a dynamics process is used to modify the probability distribution in a manner dependent on the time stamp for that weight. For example, the uncertainty about the associated variable's influence on prediction of future events is increased. Examples of different schedules for applying the dynamics process are given.

Event prediction in dynamic environments

A computationally efficient method of performing probabilistic linear regression is described. In an embodiment, the method involves adding a white noise term to a weighted linear sum of basis functions and then normalizing the combination. This generates a linear model comprising a set of sparse, normalized basis functions and a modulated noise term. When using the linear model to perform linear regression, the modulated noise term increases the variance associated with output values which are distant from any data points.

Computationally efficient probabilistic linear regression

Growing community of inventors

Cambridge, United Kingdom

Joaquin Quinonero Candela