Microsoft Technology Licensing, LLC

Drew Edward Steedly

Richard S Szeliski

Frederik Schaffalitzky

Michael Edward Samples

Ethan Eade

Alexandru Octavian Balan

Sudipta Narayan Sinha

Michael Ebstyne

Quentin Simon Charles Miller

Andrew Clark Goris

Georg Klein

Matthew Uyttendaele

Steven John Robbins

Nathan Ackerman

Martin Thomas Shetter

Ian Douglas McIntyre

William Douglas Guyman

Ivan Razumenic

Vuk Jovanovic

Vladimir Carapic

Taras Khapko

Stephen G Latta

Michael F Cohen

Arthur Charles Tomlin

Denis Demandolx

Alex A Kipman

Adam G Poulos

Kathleen Patricia Mulcahy

Maneesh Agrawala

Tony Ambrus

Jeffrey Cole

Zhiqiang Liu

Michael Grabner

Todd Michael Lyon

Andrew Kilgour Juenger

Youding Zhu

Jelena Mojasevic

Qi Kuan Zhou

Marko Bezulj

Chris Pal

David Douglas Bohn

David Nister

Desney S Tan

Scott Charles McEldowney

Rod G Fleck

Alex Aben-Athar Kipman

Daniel Joseph McCulloch

Eric H Rudolph

Ben J Sugden

Brian James Mount

Patrick Markus Baudisch

Ryan Lucas Hastings

Ming Gang Liu

Raman Narayanan

Lutz Gerhard

Yarn Chee Poon

Radoslav Petrov Nickolov

Lev Cherkashin

Xinye Lou

Cynthia Sue Bell

Steve Robbins

Steven James Velat

Jedd Perry

Paul Albert Lalonde

Salim Sirtkaya

James Peele Terrell, Jr

Calvin Chan

Filip Panjevic

Joachim Pehserl

Jack Clevenger

Rick Szeliski

Nicholas Damien McGee

Frederick Schaffalitzky

Andy Hodge

Richard Roberts

Michael John Ebstyne

Richard Stephen Szeliski

Ian Douglas Mclntyre

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.

Object and environment tracking via shared sensor

One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.

Tracking wearable device and handheld object poses

Examples are disclosed herein related to tracking poses of a head-mounted display device that interfaces with handheld peripheral objects. One disclosed example provides a handheld object configured for providing user input to a head-mounted device, the handheld object including a body, a plurality of visible light sources arranged on the body in an arrangement trackable by a vision system of the head-mounted device, and a controller configured to control a brightness of one or more visible light sources of the plurality of visible light sources.

Controlling handheld object light sources for tracking

A display system includes a display alignment tracker configured track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal.

Display active alignment system for waveguide displays

An apparatus for dynamically determining a displacement of a target sensor in an electronic system is disclosed. The apparatus can comprise a non-line-of-sight sensor rigidly mounted on or proximate to the target sensor and configured to measure a parameter that varies with the displacement of the target sensor. The apparatus further can comprise at least one processor coupled to the non-line-of-sight sensor and configured to compute the displacement of the target sensor based on the parameter, and to compute an adjustment value based on the computed displacement.

Virtual rigid framework for sensor subsystem

An example see-through head-mounted display system includes a freeform prism and a display device configured to emit display light through the freeform prism to an eye of a user. The see-through head-mounted display system may also include an imaging device configured to receive gaze-detection light reflected from the eye and directed through the freeform prism.

Eye-tracking system using a freeform prism and gaze-detection light

Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.

Determining coordinate frames in a dynamic environment

A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.

Display active alignment systems utilizing test patterns for calibrating signals in waveguide displays

A system and method are disclosed for use in a virtual reality environment including a head mounted display device and a processing unit. In examples, the processing unit adjusts an amount by which left and right displayed images overlap each other at a given distance, such as the focal distance, from the head mounted display device.

AR display with adjustable stereo overlap zone

A system and related methods for a resource management in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. A resource management program is configured to operate a selected sensor in a default power mode to achieve a selected fidelity. The program receives user-related information from one or more of the sensors, and determines whether target information is detected. Where target information is detected, the program adjusts the selected sensor to operate in a reduced power mode that uses less power than the default power mode.

Display resource management

Embodiments are disclosed that relate to determining a pose of a device. One disclosed embodiment provides a method comprising receiving sensor information from one or more sensors of the device, and selecting a motion-family model from a plurality of different motion-family models based on the sensor information. The method further comprises providing the sensor information to the selected motion-family model and outputting an estimated pose of the device according to the selected motion-family model.

Motion modeling in visual tracking

Embodiments related to mapping an environment of a machine-vision system are disclosed. For example, one disclosed method includes acquiring image data resolving one or more reference features of an environment and computing a parameter value based on the image data, wherein the parameter value is responsive to physical deformation of the machine-vision system.

3D mapping with flexible camera rig

A head-mounted display device is disclosed, which includes an at least partially see-through display, a processor configured to detect a physical feature, generate an alignment hologram based on the physical feature, determine a view of the alignment hologram based on a default view matrix for a first eye of a user of the head-mounted display device, display the view of the alignment hologram to the first eye of the user on the at least partially see-through display, output an instruction to the user to enter an adjustment input to visually align the alignment hologram with the physical feature, determine a calibrated view matrix based on the default view matrix and the adjustment input, and adjust a view matrix setting of the head-mounted display device based on the calibrated view matrix.

Alignment based view matrix tuning

Various embodiments relating to using motion based view matrix tuning to calibrate a head-mounted display device are disclosed. In one embodiment, the holograms are rendered with different view matrices, each view matrix corresponding to a different inter-pupillary distance. Upon selection by the user of the most stable hologram, the head-mounted display device can be calibrated to the inter-pupillary distance corresponding to the selected most stable hologram.

Motion based view matrix tuning

Growing community of inventors

Woodinville, WA, United States of America

Drew Edward Steedly