Microsoft Technology Licensing, LLC

Weihua Huang

Darren Alexander Bennett

Charla Marie Pereira

Jonathon Burnham Cobb

Enrico William Guld

David J W Seymour

Kin Hang Chu

Dean Alan Wadsworth

Various methods and systems are provided for puppeteering in augmented reality. Generally, an augmented or virtual reality device for each user generates a virtual 3D environment comprising a virtual representation of a physical room and a 3D asset. An author can record a 3D path for a puppeteering animation of the 3D asset using a 3D interface. At the same time, a coordinated rendering of a corresponding 3D image moving along the 3D path is updated among author devices substantially in real-time. Distinct states of the 3D asset can be assigned to different portions of the 3D path, and authors can set behavior parameters to assign template behaviors such as obstacle avoidance, particle effects, path visualizations and physical effects. The behavior parameters are distributed among presenter and audience devices, and a coordinated rendering of an animation of the 3D image corresponding to the puppeteering animation is triggered.

Puppeteering in augmented reality

Growing community of inventors

Vancouver, Canada

Weihua Huang