Microsoft Technology Licensing, LLC

Federica Bogo

Thomas Joseph Cashman

Andrew William Fitzgibbon

Erroll William Wood

Bugra Tekin

Luca Ballan

Jan Stuehmer

Christopher Douglas Edmonds

Jamie Daniel Joseph Shotton

Marc Andre Leon Pollefeys

Muhammad Zeeshan Zia

Pashmina Cameron

Harpreet Singh Sawhney

Lucas Bordeaux

Paul Malcolm McIlroy

Sasa Galic

Huseyin Coskun

A control system comprises a memory storing a sequence of sensor data received from one or more sensors. The control system has a processor which processes the sensor data to compute a sequence of derived sensor data values. An autoencoder receives the sequence of derived sensor data values and computes a forward prediction of the sequence of derived sensor data values, the autoencoder having been trained imposing a relationship on positions of the derived sensor data values encoded in a latent space of the autoencoder. A processor initiates control of an apparatus using the forward prediction.

Control system using autoencoder

A method for virtually representing human body poses includes receiving positioning data detailing parameters of one or more body parts of a human user based at least in part on input from one or more sensors. One or more mapping constraints are maintained that relate a model articulated representation to a target articulated representation. A model pose of the model articulated representation and a target pose of the target articulated representation are concurrently estimated based at least in part on the positioning data and the one or more mapping constraints. The previously-trained pose optimization machine is trained with training positioning data having ground truth labels for the model articulated representation. The target articulated representation is output for display with the target pose as a virtual representation of the human user.

Concurrent human pose estimates for virtual representation

A computing device, including a processor configured to receive a first video including a plurality of frames. For each frame, the processor may determine that a target region of the frame includes a target object. The processor may determine a surrounding region within which the target region is located. The surrounding region may be smaller than the frame. The processor may identify one or more features located in the surrounding region. From the one or more features, the processor may generate one or more manipulated object identifiers. For each of a plurality of pairs of frames, the processor may determine a respective manipulated object movement between a first manipulated object identifier of the first frame and a second manipulated object identifier of the second frame. The processor may classify at least one action performed in the first video based on the plurality of manipulated object movements.

Action classification based on manipulated object movement

A data processing system is provided that includes a processor having associated memory, the processor being configured to execute instructions using portions of the memory to cause the processor to, at classification time, receive an input image frame from an image source. The input image frame includes an articulated object and a target object. The processor is further caused to process the input image frame using a trained neural network configured to, for each input cell of a plurality of input cells in the input image frame predict a three-dimensional articulated object pose of the articulated object and a three-dimensional target object pose of the target object relative to the input cell. The processor is further caused to output the three-dimensional articulated object pose and the three-dimensional target object pose from the neural network.

Predicting three-dimensional articulated and target object pose

An apparatus for detecting pose of an object is described. The apparatus has a processor configured to receive captured sensor data depicting the object. The apparatus has a memory storing a model of a class of object of which the depicted object is a member, the model comprising a plurality of parameters specifying the pose, comprising global position and global orientation, of the model. The processor is configured to compute values of the parameters of the model by calculating an optimization to fit the model to the captured sensor data, wherein the optimization comprises iterated computation of updates to the values of the parameters and updates to values of variables representing correspondences between the captured sensor data and the model, the updates being interdependent in computation. The processor is configured to discard updates to values of the variables representing correspondences without applying the updates.

Method and apparatus for prefetching data items to a cache

A ground truth engine is described which has a memory holding a plurality of captured images depicting an articulated item. A processor of the engine is configured to access a parameterized, three dimensional (3D) model of the item. An optimizer of the ground truth engine is configured to compute ground truth values of the parameters of the 3D model for individual ones of the captured images, such that the articulated item depicted in the captured image fits the 3D model, the optimizer configured to take into account feedback data from one or more humans, about accuracy of a plurality of the computed values of the parameters.

Human feedback in 3D model fitting

Growing community of inventors

Kilchberg, Switzerland

Federica Bogo