Microsoft Technology Licensing, LLC

Alliedsignal Inc.

Martin Thomas Shetter

Ashraf A Michail

Jeffrey Neil Margolis

Andrew Martin Pearson

Calvin Chan

Joseph H Matthews, Iii

Arthur Charles Tomlin

Barry J Corlett

Drew Edward Steedly

Vu Xuan Nguyen

Mark Gerard Kraus

Udiyan Padmanabhan

Jannes Paul Peters

Michael J Ricker

William Messing

Tatiana Gershanovich

Andrew Clark Goris

Michael Isard

Alexandru Octavian Balan

Nathan Ackerman

Michael Edward Samples

Paul Ronald Barham

Georg Klein

William Douglas Guyman

Kevin Woo

Ivan Razumenic

Vuk Jovanovic

Vladimir Carapic

Taras Khapko

Jelena Mojasevic

Marko Bezulj

Douglas Kevin Service

Oliver Michael Christian Williams

Tuan Wong

Stephen G Latta

Gregory Carl Hitchcock

Ethan Eade

Bodin Dresevic

Raman Kumar Sarin

Jae Pum Park

Frederik Schaffalitzky

Michael Ebstyne

Robert Thomas Held

Michael Grabner

Matthew Calbraith Crisler

Monica Gonzalez

David B Honcik

Ashraf Ayman Michail

Michael John Ebstyne

One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.

Object and environment tracking via shared sensor

Exemplary methods, apparatus, and systems are disclosed for capturing, organizing, sharing, and/or displaying media. For example, using embodiments of the disclosed technology, a unified playback and browsing experience for a collection of media can be created automatically. For instance, heuristics and metadata can be used to assemble and add narratives to the media data. Furthermore, this representation of media can recompose itself dynamically as more media is added to the collection. While a collection may use a single user's content, sometimes media that is desirable to include in the collection is captured by friends and/or others at the same event. In certain embodiments, media content related to the event can be automatically collected and shared among selected groups. Further, in some embodiments, new media can be automatically incorporated into a media collection associated with the event, and the playback experience dynamically updated.

Generating and updating event-based playback experiences

Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image by circuitry within the display.

Reprojection OLED display for augmented reality experiences

One embodiment provides a method to display video such as computer-rendered animation or other video. The method includes assembling a sequence of video frames featuring a moving object, each video frame including a plurality of subframes sequenced for display according to a schedule. The method also includes determining a vector-valued differential velocity of the moving object relative to a head of an observer of the video. At a time scheduled for display of a first subframe of a given frame, first-subframe image content transformed by a first transform is displayed. At a time scheduled for display of the second subframe of the given frame, second-subframe image content transformed by a second transform is displayed. The first and second transforms are computed based on the vector-valued differential velocity to mitigate artifacts.

Avoidance of color breakup in late-stage re-projection

Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image.

Late stage reprojection

Embodiments that relate to communicating to a user of a head-mounted display device an estimated quality level of a world-lock display mode are disclosed. For example, in one disclosed embodiment a sensor data is received from one or more sensors of the device. Using the sensor data, an estimated pose of the device is determined. Using the estimated pose, one or more virtual objects are displayed via the device in either the world-lock display mode or in a body-lock display mode. One or more of input uncertainty values of the sensor data and pose uncertainty values of the estimated pose are determined. The input uncertainty values and/or pose uncertainty values are mapped to the estimated quality level of the world-lock display mode. Feedback of the estimated quality level is communicated to a user via device.

World-locked display quality feedback

Event-based media grouping, playback, and sharing

Disclosed is a 'keyboard overlay' that sits on top of a touch-sensitive display screen of a computing device. After aligning the overlay on the display screen, the user types on the overlay. When the user presses a key on the overlay, the pressure is transmitted to the display screen below. That pressure is registered by the display screen as a touch. The keyboard overlay is formed to provide tactile finger-position feedback so that a user can keep his fingers oriented properly over the keyboard. The overlay may be opaque with keycap information displayed in the key areas. The overlay may be transparent, allowing a user to see a virtual keyboard painted on the display screen below. The computing device can detect the presence and type of an overlay. Applications may respond differently to different types of overlays. Different applications may be invoked depending upon the type of overlay detected.

Method and system for using a keyboard overlay with a touch-sensitive display screen

A virtual keyboard displayed on a touch sensitive screen allows a user to do touch-typing thereon to enter textual data into a computer. The keyboard image has a standard key layout for typewriting, and the keys are sized to allow the fingers of the user to take the positions necessary for 'ten-finger' touch-typing in the standard fashion. The virtual keyboard image is semi-transparently displayed over on a background image, with the individual keys shown with shaded edges so that they can be easily distinguished from features in the background image. When a key is touched, a sound is generated. The sound generated when the touch is away from a target portion of the key is different from the sound generated when the touch is on or adjacent to the target portion of the key, thereby providing audio feedback to enable the user to adjust finger positions to maintain proper alignment with the virtual keys.

Virtual keyboard for touch-typing using audio feedback

Growing community of inventors

Bellevue, WA, United States of America

Martin Thomas Shetter