Microsoft Technology Licensing, LLC

Google Inc.

Sebastian Sylvan

Daniel Joseph McCulloch

Arthur Charles Tomlin

Brian James Mount

Darren Bennett

Ryan Lucas Hastings

Kevin Geisner

Ben J Sugden

Stephen G Latta

Robert L Crocco, Jr

David Douglas Bohn

Rod G Fleck

Jason Bradley Scott

Alex A Kipman

Jeffrey Alan Kohler

Jonathan Steed

Mathew Julian Lamb

Brian C McDowell

Julia Louise Meinershagen

Nicholas David Burton

Jeff Cole

Robert Crocco

Mohammad Moharrami

David Chu

Ivana Tosic Rodgers

Grigory Javadyan

Egor Yusov

Kelvin Ritland

Bernhard Reinert

A method includes obtaining a first frame of image data including a plurality of pixels. Each pixel of the plurality of pixels is associated with a respective color value and a respective depth value. The first frame renders a scene from a first point of view. The method includes generating a three-dimensional (3D) polygon mesh using the plurality of pixels and the respective depth values. The 3D polygon mesh includes a plurality of portions. Each respective portion defines a respective plurality of vertices defining a respective mesh density representative of a density of the respective plurality of vertices. Each vertex is associated with a corresponding pixel of the first frame of image data. The method includes generating a second frame of image data via reprojection using the generated 3D polygon mesh. The second frame of image data has a second point of view different from the first point of view.

Adaptive mesh reprojection for low latency 6DOF rendering

Systems, methods, and computer program products are described for receiving a request for a head pose prediction for an augmented reality experience, identifying at least one positional indicator and at least one rotational indicator associated with the augmented reality experience, and providing the at least one positional indicator and the at least one rotational indicator to a Recurrent Neural Network (RNN) comprising a plurality of cells. The RNN may include a plurality of recurrent steps that each include at least one of the plurality of cells and at least one fully connected (FC) layer. The RNN may be used to generate at least one pose prediction corresponding to head pose changes for the augmented reality experience for at least one upcoming time period, provide the at least one pose prediction and trigger display of augmented reality content based on the at least one pose prediction.

Pose prediction with recurrent neural networks

A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Virtual light in augmented reality

A system and related methods for visually augmenting an appearance of a physical environment as seen by a user through a head-mounted display device are provided. In one embodiment, a virtual environment generating program receives eye-tracking information, lighting information, and depth information from the head-mounted display. The program generates a virtual environment that models the physical environment and is based on the lighting information and the distance of a real-world object from the head-mounted display. The program visually augments a virtual object representation in the virtual environment based on the eye-tracking information, and renders the virtual object representation on a transparent display of the head-mounted display device.

Virtual environment generating system

A system is disclosed for rendering low latency resource objects by providing the latest position data from a central processing unit for the low latency resource object right before a graphic processing unit is to render the low latency resource object.

Low latency rendering of objects

A blocking image generating system and related methods include a head-mounted display device having an opacity layer. A method may include receiving a virtual image to be presented by display optics in the head-mounted display device. Lighting information and an eye-position parameter may be received from an optical sensor system in the head-mounted display device. A blocking image may be generated in the opacity layer of the head-mounted display device based on the lighting information and the virtual image. The location of the blocking image in the opacity layer may be adjusted based on the eye-position parameter.

Display with blocking image generation

Growing community of inventors

Seattle, WA, United States of America

Sebastian Sylvan