Microsoft Technology Licensing, LLC

Dag Birger Frommhold

Ashraf A Michail

Christian Voss-Wolff

Benjamin Markus Thaut

Florian Bagar

Pavlos Mavridis

Adam Andrzej Cichocki

Jonathan Lyons

Christian Voss-wolff

Marc Schirski

In various examples there is a method performed by a Head Mounted Display, HMD, comprising a high field rate display configured to display fields of rendered frames at a field rate. The method comprises receiving a stream of the rendered frames for display on the high field rate display, the stream of rendered frames having a frame rate. The process applies an early stage reprojection to the rendered frames of the stream of rendered frames at a rate which is lower than the field rate. The process applies a late stage reprojection to fields of the rendered frames at the field rate, wherein the early stage reprojection uses more computational resources than the late reprojection.

Reprojection for high field rate displays

Sending streamed data packets from a producer to a consumer. A method includes, at a first entity, sending consumable data packets from the first entity to a second entity at a first consumable packet rate. The method further includes receiving a first phase delta from the second entity, wherein the first phase delta is computed from transmission jitter, computed from timing information in the consumable data packets. The method further includes sending from the first entity consumable data packets at a second consumable packet rate, the second consumable packet rate being dependent on the first phase delta.

Latency reduction in remote rendering with adaptive phase shifting

One disclosed example provides a computing device comprising a processing device and a storage device storing instructions executable by the processing device to execute in a first local process an application that outputs digital content for rendering and display. During execution of the application, the instructions are executable to provide, to a second local or remote process, object information regarding an object to be rendered by the second local or remote process, receive, from the second local or remote process, a rendering of the object, output the rendering of the object to display the object, receive a manipulation made to the object, provide, to the second local or remote process, updated object information based on the manipulation made to the object, receive, from the second local or remote process, an updated rendering of the object, and output the updated rendering of the object to display the object.

Hybrid rendering

Examples are disclosed that relate to computing devices, head-mounted display (HMD) devices, and methods for displaying an image via a display device. In one example, a method for displaying an image via a display device comprises receiving an original frame of reference, determining a rotated device orientation of the display device, and modifying the original frame of reference to a rotated frame of reference based on the rotated device orientation. The method further comprises sampling data describing a virtual world at the rotated frame of reference to produce an intermediate image frame, generating a final image frame by back-rotating the intermediate image frame to the original frame of reference, and displaying the final image frame via the display device.

Image display using rotated frame of reference

Examples are disclosed that relate to culling of polygons for efficient rendering of a high-density polygon mesh using one or more compute shaders. Examples include monoscopic and stereoscopic rendering, foveated and non-foveated rendering, and selectively utilizing one or more computer shaders to rasterize very small triangles instead of using a regular rendering pipeline for increased performance.

Efficient rendering of high-density meshes

A method for compressing a depth image including a matrix of pixels, each pixel including a pixel depth value, includes dividing the depth image into a plurality of non-overlapping tiles. Each of the plurality of non-overlapping tiles includes a contiguous subset of pixels. For each of the plurality of non-overlapping tiles, the pixel depth values are quantized into quantized pixel depth values. For each of the plurality of non-overlapping tiles, the quantized pixel depth values are encoded into a compressed depth image.

Depth image compression

A method for compressing depth information for a three-dimensional virtual scene includes, at a computing device, recognizing a three-dimensional virtual scene including one or more locally-maintained virtual objects. Positioning information for one or more remotely-maintained virtual objects to be included in the three-dimensional virtual scene are received from a remote device. For a virtual view of the three-dimensional virtual scene having a virtual perspective, different portions of the virtual view are classified as belonging to one of a plurality of different occlusion classes, each of the plurality of different occlusion classes specifying an occlusion relationship between locally-maintained virtual objects and remotely-maintained virtual objects in the virtual view. A depth-compressed representation indicating the occlusion class for each of the different portions of the virtual view is output to the remote device.

Growing community of inventors

Metzingen, Germany

Dag Birger Frommhold