Microsoft Technology Licensing, LLC

Telefonaktiebolaget Lm Ericsson (publ)

Alex A Kipman

Kathryn Stone Perez

Kudo Tsunoda

Stephen G Latta

Michael Ebstyne

Relja Markovic

Ben J Sugden

Darren Bennett

Mark James Finocchio

Peter Tobias Kinnebrew

Ryan M Geiss

Oscar E Murillo

Yuri Pekelny

Robert L Crocco, Jr

Nicholas Ferianc Kamuda

R Stephen Polzin

Laura K Massey

Brian E Keane

Pedro Urbina Escos

Emanuel Shalev

Daniel Deptford

Thomas Salter

Jonathan Chi Hang Chan

Kevin Geisner

Daniel Joseph McCulloch

Jason Bradley Scott

Ryan Lucas Hastings

Nicholas David Burton

Andrew Wilson

Jeffrey Neil Margolis

Cameron Graeme Brown

Janet Ellen Galore

John Clavin

Nicholas Fajt

Michael Scavezze

Tony Ambrus

John Bevis

Jamie Bryant Kirschenbaum

Zachary Quarles

Michael Klucher

Andy D Wilson

Avi Bar-Zeev

Ethan Eade

John R Lewis

Todd E Holmdahl

Drew Edward Steedly

Frederik Schaffalitzky

Gregory Nelson Snook

Bob Crocco

Purnima M Rao

Stuart John Mayhew

Carlos Fernando Faria Costa

Rebecca Haruyama

Shih-Sang Carnaven Chiu

Mark Flick

Andrew David Wilson

Christian Klein

Arthur Charles Tomlin

Brian James Mount

Andrew John Fuller

Adam G Poulos

Jonathan Steed

Mathew Julian Lamb

Zsolt Mathe

Brian Murphy

Charles Claudius Marais

Johnny Chung Lee

Ali M Vassigh

Darren Alexander Bennett

Jomo Fisher

Todd Omotani

Georg Klein

Paul Albert Lalonde

Chad W Royal

Sebastian Sylvan

Brian Kramp

Jeremy Richard Hill

Calvin Chan

William Guo

Marcus Tanner

Andrew Lawrence Mattingly

Robert Crocco

Jonathan R Christen

Robert Courtney Memmott

Diego Fernandes Nehab

John Charles Howard

James Theodore Reichert, Jr

Arjun Dayal

Rajeev Goel

Christopher A Flaat

Gregory G Snook

Kenneth Charles Ouellette

Nicholas D Burton

Michael John Ebstyne

Robert L Crocco

Thomas G Salter

Thomas George Salter

A synthetic world interface may be used to model digital environments, sensors, and motions for the evaluation, development, and improvement of localization algorithms. A synthetic data cloud service with a library of sensor primitives, motion generators, and environments with procedural and game-like capabilities, facilitates engineering design for a manufactural solution that has localization capabilities. In some embodiments, a sensor platform simulator operates with a motion orchestrator, an environment orchestrator, an experiment generator, and an experiment runner to test various candidate hardware configurations and localization algorithms in a virtual environment, advantageously speeding development and reducing cost. Thus, examples disclosed herein may relate to virtual reality (VR) or mixed reality (MR) implementations.

Spatial localization design service

A synthetic world interface may be used to model digital environments, sensors, and motions for the evaluation, development, and improvement of computer vision and speech algorithms. A synthetic data cloud service with a library of sensor primitives, motion generators, and environments with procedural and game-like capabilities, facilitates engineering design for a manufactural solution that has computer vision and speech capabilities. In some embodiments, a sensor platform simulator operates with a motion orchestrator, an environment orchestrator, an experiment generator, and an experiment runner to test various candidate hardware configurations and computer vision and speech algorithms in a virtual environment, advantageously speeding development and reducing cost. Thus, examples disclosed herein may relate to virtual reality (VR) or mixed reality (MR) implementations.

Computer vision and speech algorithm design service

A mixed-reality display device comprises an input system, a display, and a graphics processor. The input system is configured to receive a parameter value, the parameter value being one of a plurality of values of a predetermined range receivable by the input system. The display is configured to display virtual image content that adds an augmentation to a real-world environment viewed by a user of the mixed-reality display device. The graphics processor is coupled operatively to the input system and to the display; it is configured to render the virtual image content so as to variably change the augmentation, to variably change a perceived realism of the real world environment in correlation to the parameter value.

Reality mixer for mixed reality

A system to present the user a 3-D virtual environment as well as non-visual sensory feedback for interactions that user makes with virtual objects in that environment is disclosed. In an exemplary embodiment, a system comprising a depth camera that captures user position and movement, a three-dimensional (3-D) display device that presents the user a virtual environment in 3-D and a haptic feedback device provides haptic feedback to the user as he interacts with a virtual object in the virtual environment. As the user moves through his physical space, he is captured by the depth camera. Data from that depth camera is parsed to correlate a user position with a position in the virtual environment. Where the user position or movement causes the user to touch the virtual object, that is determined, and corresponding haptic feedback is provided to the user.

Systems and methods for immersive interaction with virtual objects

Techniques for assigning a gesture dictionary in a gesture-based system to a user comprise capturing data representative of a user in a physical space. In a gesture-based system, gestures may control aspects of a computing environment or application, where the gestures may be derived from a user's position or movement in a physical space. In an example embodiment, the system may monitor a user's gestures and select a particular gesture dictionary in response to the manner in which the user performs the gestures. The gesture dictionary may be assigned in real time with respect to the capture of the data representative of a user's gesture. The system may generate calibration tests for assigning a gesture dictionary. The system may track the user during a set of short gesture calibration tests and assign the gesture dictionary based on a compilation of the data captured that represents the user's gestures.

Assigning gesture dictionaries

An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present.

Opacity filter for display device

A computing system and method for producing and consuming metadata within multi-dimensional data is provided. The computing system comprising a see-through display, a sensor system, and a processor configured to: in a recording phase, generate an annotation at a location in a three dimensional environment, receive, via the sensor system, a stream of telemetry data recording movement of a first user in the three dimensional environment, receive a message to be recorded from the first user, and store, in memory as annotation data for the annotation, the stream of telemetry data and the message, and in a playback phase, display a visual indicator of the annotation at the location, receive a selection of the visual indicator by a second user, display a simulacrum superimposed onto the three dimensional environment and animated according to the telemetry data, and present the message via the animated simulacrum.

Producing and consuming metadata within multi-dimensional data

Embodiments that relate to presenting a mixed reality environment via a mixed reality display device are disclosed. For example, one disclosed embodiment provides a method for presenting a mixed reality environment via a head-mounted display device. The method includes using head pose data to generally identify one or more gross selectable targets within a sub-region of a spatial region occupied by the mixed reality environment. The method further includes specifically identifying a fine selectable target from among the gross selectable targets based on eye-tracking data. Gesture data is then used to identify a gesture, and an operation associated with the identified gesture is performed on the fine selectable target.

Mixed reality presentation

A system recognizes human beings in their natural environment, without special sensing devices attached to the subjects, uniquely identifies them and tracks them in three dimensional space. The resulting representation is presented directly to applications as a multi-point skeletal model delivered in real-time. The device efficiently tracks humans and their natural movements by understanding the natural mechanics and capabilities of the human muscular-skeletal system. The device also uniquely recognizes individuals in order to allow multiple people to interact with the system via natural movements of their limbs and body as well as voice commands/responses.

Device for identifying and tracking multiple humans over time

An virtual character such as an on-screen object, an avatar, an on-screen character, or the like may be animated using a live motion of a user and a pre-recorded motion. For example, a live motion of a user may be captured and a pre-recorded motion such as a pre-recorded artist generated motion, a pre-recorded motion of the user, and/or a programmatically controlled transformation may be received. The live motion may then be applied to a first portion of an the virtual character and the pre-recorded motion may be applied to a second portion of the virtual character such that the virtual character may be animated with a combination of the live and pre-recorded motions.

Systems and methods for applying animations or motions to a character

Growing community of inventors

Duvall, WA, United States of America

Alex A Kipman