Microsoft Technology Licensing, LLC

Telefonaktiebolaget Lm Ericsson (publ)

Other

Alex Aben-Athar Kipman

Kathryn Stone Perez

Ben J Sugden

Robert L Crocco, Jr

Benjamin Isaac Vaught

Brian E Keane

Laura K Massey

Stephen G Latta

Kevin Geisner

Mathew Julian Lamb

Avi Bar-Zeev

John R Lewis

Christopher E Miles

Andrew John Fuller

Daniel Joseph McCulloch

Jeffrey Neil Margolis

Jason Bradley Scott

Tom G Salter

Darren Bennett

Nicholas Ferianc Kamuda

Peter Tobias Kinnebrew

Sheridan Martin Small

Daniel Deptford

Bob Crocco

Ryan Lucas Hastings

John Clavin

Jason S Flaks

Kenneth Alan Lobb

Yichen Wei

John Allen Tardif

Relja Markovic

John Raymond Justice

Shao Liu

Rudy Jacobus Poot

Roger Sebastian Kevin Sylvan

Chris Miles

Rudy Poat

Zhengyou Zhang

Brian James Mount

Ashraf A Michail

Mark James Finocchio

Jonathan Steed

Michael Scavezze

Quentin Simon Charles Miller

John A Shepard

Felix Cheung

Robert Crocco

Christian F Huitema

Ryan M Geiss

Arthur Charles Tomlin

Dawson Yee

Michael H LaManna

Cameron Graeme Brown

Alexandru Octavian Balan

Jeffrey Alan Kohler

Nathan Ackerman

Drew Edward Steedly

David D Hayes

Jeffrey Cole

Gregory A Martinez

Ian Douglas McIntyre

Kyungsuk David Lee

Eric Glenn Lang

Britta Silke Hummel

Jamie Shotton

Timothy R Sullivan

Richard E Moore

Dale Rogerson

Ben Vaught

Justin McRoberts

Holly A Hirzel

Joseph Reginald Scott Molnar

Oliver Michael Christian Williams

Arnulfo Zepeda Navratil

Rajeev Goel

Scott R Swanson

Matheen Siddiqui

Aaron E Kornblum

Philip Greenhalgh

David Hayes

Erik Neuenschwander

Letha Radebaugh

Tricia Lee

Jonathan Cannon Gordon

Madhavi Lakamsani

Paul Glenn McKee

Saurabh Jain

Octavia Petrovici

Kathryn Stonw Perez

Joseph Molnar

Andy Hodge

Ashraf Ayman Michail

Robert L Crocco

John Lewis

Avi Bar-Zeeb

A see through head mounted display apparatus includes code performing a method of choosing and optimal viewing location and perspective for shared-view virtual objects rendered for multiple users in a common environment. Multiple objects and multiple users are taken into account in determining the optimal, common viewing location. The technology allows each user to have a common view if the relative position of the object in the environment.

Concurrent optimal viewing of virtual objects

An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present.

Opacity filter for display device

A system for allowing a virtual object to interact with other virtual objects across different spaces within an augmented reality (AR) environment and to transition between the different spaces is described. An AR environment may include a plurality of spaces, each comprising a bounded area or volume within the AR environment. In one example, an AR environment may be associated with a three-dimensional world space and a two-dimensional object space corresponding with a page of a book within the AR environment. A virtual object within the AR environment may be assigned to the object space and transition from the two-dimensional object space to the three-dimensional world space upon the detection of a space transition event. In some cases, a dual representation of the virtual object may be used to detect interactions between the virtual object and other virtual objects in both the world space and the object space.

Mechanism to give holographic objects saliency in multiple spaces

The technology provides contextual personal information by a mixed reality display device system being worn by a user. A user inputs person selection criteria, and the display system sends a request for data identifying at least one person in a location of the user who satisfy the person selection criteria to a cloud based application with access to user profile data for multiple users. Upon receiving data identifying the at least one person, the display system outputs data identifying the person if he or she is within the field of view. An identifier and a position indicator of the person in the location is output if not. Directional sensors on the display device may also be used for determining a position of the person. Cloud based executing software can identify and track the positions of people based on image and non-image data from display devices in the location.

Providing location occupancy analysis via a mixed reality device

A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is not focused on the virtual object, which may be a heads-up display, or HUD, the HUD may remain body locked to the user. As such, the user may explore and interact with a mixed reality environment presented by the head mounted display device without interference from the HUD. When a user wishes to view and/or interact with the HUD, the user may look at the HUD. At this point, the HUD may change from a body locked virtual object to a world locked virtual object. The user is then able to view and interact with the HUD from different positions and perspectives of the HUD.

Hybrid world/body locked HUD on an HMD

A method and apparatus for the creation of a perspective-locked virtual object having in world space. The virtual object may be consumed) by another user with a consumption device at a location, position, and orientation which is the same as, or proximate to, the location, position, and orientation where the virtual object is created. Objects may have one, few or many allowable consumption locations, positions, and orientations defined by its creator.

Virtual object orientation and visualization

Embodiments are described herein for determining a stabilization plane to reduce errors that occur when a homographic transformation is applied to a scene including 3D geometry and/or multiple non-coplanar planes. Such embodiments can be used, e.g., when displaying an image on a head mounted display (HMD) device, but are not limited thereto. In an embodiment, a rendered image is generated, a gaze location of a user is determined, and a stabilization plane, associated with a homographic transformation, is determined based on the determined gaze location. This can involve determining, based on the user's gaze location, variables of the homographic transformation that define the stabilization plane. The homographic transformation is applied to the rendered image to thereby generate an updated image, and at least a portion of the updated image is then displayed.

Stabilization plane determination based on gaze location

Embodiments of the present invention allow players to instantly access and begin playing games through an online service. To make the games instantly available, an online service keeps instances of games running in active memory waiting for a player to be added. The game instances running in active memory are not attached to a player profile or an I/O channel from a game client. Once the player requests a game, the player's player profile is loaded into the running game instance and an I/O channel is mapped from the game client to the game instance. From the player's perspective, the preloaded game instances allow the player to browse directly from game to game with very little delay. To optimize the usage of server-side resources, historical usage data may be analyzed to anticipate demand for different games.

Game browsing

Technology is described for resource management based on data including image data of a resource captured by at least one capture device of at least one personal audiovisual (A/V) apparatus including a near-eye, augmented reality (AR) display. A resource is automatically identified from image data captured by at least one capture device of at least one personal A/V apparatus and object reference data. A location in which the resource is situated and a 3D space position or volume of the resource in the location is tracked. A property of the resource is also determined from the image data and tracked. A function of a resource may also be stored for determining whether the resource is usable for a task. Responsive to notification criteria for the resource being satisfied, image data related to the resource is displayed on the near-eye AR display.

Personal audio/visual apparatus providing resource management

Technology is disclosed herein to help a user navigate through large amounts of content while wearing a see-through, near-eye, mixed reality display device such as a head mounted display (HMD). The user can use a physical object such as a book to navigate through content being presented in the HMD. In one embodiment, a book has markers on the pages that allow the system to organize the content. The book could have real content, but it could be blank other than the markers. As the user flips through the book, the system recognizes the markers and presents content associated with the respective marker in the HMD.

Navigating content using a physical object

An audio/visual system (e.g., such as an entertainment console or other computing device) plays a base audio track, such as a portion of a pre-recorded song or notes from one or more instruments. Using a depth camera or other sensor, the system automatically detects that a user (or a portion of the user) enters a first collision volume of a plurality of collision volumes. Each collision volume of the plurality of collision volumes is associated with a different audio stem. In one example, an audio stem is a sound from a subset of instruments playing a song, a portion of a vocal track for a song, or notes from one or more instruments. In response to automatically detecting that the user (or a portion of the user) entered the first collision volume, the appropriate audio stem associated with the first collision volume is added to the base audio track or removed from the base audio track.

Interactive content creation

A system for generating and displaying holographic visual aids associated with a story to an end user of a head-mounted display device while the end user is reading the story or perceiving the story being read aloud is described. The story may be embodied within a reading object (e.g., a book) in which words of the story may be displayed to the end user. The holographic visual aids may include a predefined character animation that is synchronized to a portion of the story corresponding with the character being animated. A reading pace of a portion of the story may be used to control the playback speed of the predefined character animation in real-time such that the character is perceived to be lip-syncing the story being read aloud. In some cases, an existing book without predetermined AR tags may be augmented with holographic visual aids.

Synchronizing virtual actor's performances to a speaker's voice

Growing community of inventors

Redmond, WA, United States of America

Alex Aben-Athar Kipman