Microsoft Technology Licensing, LLC

Paul Malcolm McIlroy

Christopher Douglas Edmonds

Andrew William Fitzgibbon

Matthew Alastair Johnson

Thomas Joseph Cashman

Erroll William Wood

Tadas Baltrusaitis

Christopher Maurice Mei

Stephan Joachim Garbin

Marek Adam Kowalski

Federica Bogo

Virginia Estellers Casas

Daniel Stephen Wilde

Marta Malgorzata Wilczkowiak

In various examples there is an apparatus for computing an image depicting a face of a wearer of a head mounted display (HMD), as if the wearer was not wearing the HMD. An input image depicts a partial view of the wearer's face captured from at least one face facing capture device in the HMD. A machine learning apparatus is available which has been trained to compute expression parameters from the input image. A 3D face model that has expressions parameters is accessible as well as a photorealiser being a machine learning model trained to map images rendered from the 3D face model to photorealistic images. The apparatus computes expression parameter values from the image using the machine learning apparatus. The apparatus drives the 3D face model with the expression parameter values to produce a 3D model of the face of the wearer and then renders the 3D model from a specified viewpoint to compute a rendered image. The rendered image is upgraded to a photorealistic image using the photorealiser.

Computing images of head mounted display wearer

An apparatus for detecting pose of an object is described. The apparatus has a processor configured to receive captured sensor data depicting the object. The apparatus has a memory storing a model of a class of object of which the depicted object is a member, the model comprising a plurality of parameters specifying the pose, comprising global position and global orientation, of the model. The processor is configured to compute values of the parameters of the model by calculating an optimization to fit the model to the captured sensor data, wherein the optimization comprises iterated computation of updates to the values of the parameters and updates to values of variables representing correspondences between the captured sensor data and the model, the updates being interdependent in computation. The processor is configured to discard updates to values of the variables representing correspondences without applying the updates.

Method and apparatus for prefetching data items to a cache

Growing community of inventors

Cambridge, United Kingdom

Paul Malcolm McIlroy