Google Inc.

Manfred Ernst

Daniel William Erickson

Harrison McKenzie Chapter

Matthew Milton Pharr

Silviu Borac

Puneet Lall

Harrison Mckenzie Chapter

An HMD device identifies a pose of the device and identifies a subset of a plurality of camera viewpoints of a light-field based on the pose. The HMD device interpolates image data of the light-field based on the pose and the subset of the plurality of camera viewpoints to generate an interpolated view; and displays at the HMD device an image based on the interpolated view. By interpolating based on the subset of camera viewpoints, the HMD device can reduce processing overhead and improve the user experience.

Light-field viewpoint and pixel culling for a head mounted display device

In one general aspect, a computer-implemented method can include identifying a plurality of pixel samples included in a layered depth image (LDI) representation of a scene for rendering in a three-dimensional (3D) image in a virtual reality (VR) space, grouping, by a processor, a subset of the plurality of pixel samples into a block of data, including extracting each pixel sample included in the subset of the plurality of pixel samples from the LDI representation of the scene for inclusion in the block of data based on an error metric associated with the respective pixel sample, creating, by the processor, a texture map for a block of data, the texture map being associated with the block of data, storing the block of data and the texture map, and triggering a rendering of the 3D image in the VR space using the block of data and the texture map.

Image based rendering techniques for virtual reality

In one general aspect, a method can include combining a partition polygon and a generated texture map to form a model of a scene for rendering in three dimensions in a virtual reality space. The generating of the texture map can include projecting a Layered Depth Image sample in a partition polygon to a point in a source camera window space, projecting the point back into the partition polygon as a surface element (surfel), projecting the surfel to a surfel footprint in a target camera window space, projecting from the target camera window space to the partition polygon, sub-pixel samples included in pixels covered by the surfel footprint, projecting the sub-pixel samples from the partition polygon and into the source camera window space, and applying a color weight to each sub-pixel sample based on the location of the sample in the source camera window space.

Growing community of inventors

Mountain View, CA, United States of America

Manfred Ernst