Microsoft Technology Licensing, LLC

Jack Elliott

Andrew Zicheng Yeung

Michael George Boulton

Matthew David Sandy

Brent Michael Wilson

Ashraf A Michail

Jason Matthew Gould

Matthew L Bronder

Alexander Nankervis

Matt Bronder

Yang You

Methods and devices for performing one step compositing may include receiving at least a first surface from a first image source and a second surface from a second image source. The methods and devices may include generating a composite image with a combined first surface and second surface by contemporaneously applying position corrections to the first surface and the second surface and lens distortion corrections to the first surface and the second surface and blending the first surface and the second surface into respective positions in the composite image. The methods and devices may include transmitting the composite image representing a virtual environment for presentation to a downstream consumer.

Virtual reality image compositing

Examples described herein generally relate to displaying an image on a display device where a motion during a latency between a first time associated with activating a first portion of the display device and a second time associated with activating a second portion of the display device is predicted. At least a second portion of an image, to be displayed at the second time, is distorted based at least in part on a function of the motion and the latency to compensate for the latency. A first portion of the image is displayed at the first time by activating the first portion of the display device. The second portion of the image, as distorted, is displayed at the second time by activating the second portion of the display device.

Techniques for compensating variable display device latency in image display

Methods and devices for managing first-in first-out (FIFO) queues in graphics processing are described. A write operation can be executed by multiple write threads on a graphics processing unit (GPU) to write data to memory locations in the multiple pages of memory. Similarly, and/or simultaneously, a read operation can be executed by multiple read threads to read data from the memory locations. The write and read operations include updating a pointer or multiple pointers indicating the point at which all preceding data has been fully written, or fully read. The read and write operations can also include maintaining and advancing one or more allocation pointers, and performing comparisons with the read and write done pointers, and/or various methods of synchronization, to handle overflow and underflow scenarios, to ensure read operations only read valid data, and write operations do not attempt to write to locations which are already in use.

Techniques for safely and efficiently enqueueing and dequeueing data on a graphics processor

Examples described herein generally relate to performing frame extrapolation in image frame rendering. A vertex mesh as a set of vertices is generated, and each vertex is mapped to a screen space position for defining a texture. One or more motion vectors for one or more regions in a first image frame of a stream of image frames can be determined. The screen space positions associated with at least a portion of the set of vertices within the texture can be modified based at least in part on the one or more motion vectors. A graphics processing unit (GPU) can render the first image frame into the texture. The extrapolated image frame is displayed after the first image frame and before a next image frame in the stream of image frames.

Techniques for extrapolating image frames

Methods and devices for processing image frames is described. The techniques presented herein leverage known characteristics of the optical transfer component in order to modify the resource allocation for rendering the subset of pixels whose contribution to the final rendered image is less than a contribution threshold. Thus, in situations where the deflection of light from the lens may impact the contribution of the one or more subset of pixels of an image frame towards the final rendered image, the image processing techniques presented here may either omit or deprioritize the identified subset of pixels in order to conserve valuable resources (e.g., dedicate less processing time and memory to rendering the identified subset of pixels).

Lens contribution-based virtual reality display rendering

Examples described herein generally relate to prioritizing portions of images for rendering in a computing device. A probability field for prioritizing portions of an image of a scene for processing can be determined, where the probability field includes a set of values each corresponding to a likelihood of a rendering parameter acquiring an altered value between a render time at which at least a portion of the image is rendered and a display time at which the image is displayed. A shaped probability field can be generated based at least in part on applying the probability field to an original target shape associated with a display. The shaped probability field can be provided to a downstream node for prioritizing, based at least in part on one or more of the set of values in the probability field, a portion of the image in processing the image.

Techniques for predictive prioritization of image portions in processing graphics

Examples described herein generally relate to rendering graphics in a computing device. A processing over-budget condition related to rendering a frame can be detected, based on which a value of a rendering parameter for a layer, where the layer is one of multiple layers to render for the frame can be modified. The layer can be rendered based at least in part on the value of the rendering parameter while one or more other layers of the multiple layers can be rendered based on respective values for the rendering parameter. The value of the rendering parameter for the layer can be different from at least one of the respective values of the rendering parameter for the one or more other layers.

Growing community of inventors

Seattle, WA, United States of America

Jack Elliott