Microsoft Technology Licensing, LLC

Chris Miles

Alex Aben-Athar Kipman

Andrew John Fuller

Jeffrey Neil Margolis

Jason S Flaks

Rudy Jacobus Poot

Avi Bar-Zeev

Robert L Crocco, Jr

Bob Crocco

An audio/visual system (e.g., such as an entertainment console or other computing device) plays a base audio track, such as a portion of a pre-recorded song or notes from one or more instruments. Using a depth camera or other sensor, the system automatically detects that a user (or a portion of the user) enters a first collision volume of a plurality of collision volumes. Each collision volume of the plurality of collision volumes is associated with a different audio stem. In one example, an audio stem is a sound from a subset of instruments playing a song, a portion of a vocal track for a song, or notes from one or more instruments. In response to automatically detecting that the user (or a portion of the user) entered the first collision volume, the appropriate audio stem associated with the first collision volume is added to the base audio track or removed from the base audio track.

Interactive content creation

A method for controlling presentation of three dimensional (3D) animation includes rendering a 3D animation sequence including a 3D vertex-baked model which is derived from a 3D animation file including vertex data of every vertex for every 3D image frame in the 3D animation sequence. The 3D vertex-baked model includes a control surface that provides a best-fit 3D shape to vertices of the 3D vertex-baked model. The method further includes receiving a motion control input, and if the motion control input is received during an augmentation portion of the 3D animation sequence, deviating from a default posture of the control surface in accordance with the motion control

Vertex-baked three-dimensional animation augmentation

A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The system creates a volumetric model of a space, segments the model into objects, identifies one or more of the objects including a first object, and displays a virtual image over the first object on a display (of the head mounted display) that allows actual direct viewing of at least a portion of the space through the display.

Fusing virtual content into real content

Growing community of inventors

Seattle, WA, United States of America

Chris Miles