Google Inc.

Patrick Llull

John D Perreault

Brion Koprowski

Andrew Gerrit Huibers

Jonathan J Huang

Adrian Wong

Justin S Legakis

A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.

Viewing-angle-dependent color/brightness correction for display system

A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.

Near-eye display with extended accommodation range adjustment

A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.

Beam steering optics for near-eye and head mounted displays

A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.

Beam steering optics for virtual reality systems

A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.

Augmented reality light field head-mounted displays

A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.

Active LCD shutters for virtual and augmented reality low persistence

A near-eye display system includes display panel to display a near-eye lightfield frame comprising an array of elemental images and a lenslet array to present the integral lightfield frame to a user's eye. The system further includes a rendering component to generate an array of elemental images based at least in part on a sparse sampling of a source image to decrease an overlap of image data contained within each individual elemental of the array of elemental images. A method of operation of the near-eye display system includes generating an array of elemental images forming the integral lightfield frame based on a sparse sampling of the current viewpoint of the subject object to decrease an overlap of image data contained within each individual elemental image of the array.

Near-eye display with sparse sampling super-resolution

A near-eye display system includes a display panel to display a lightfield image comprising an array of elemental images and a lenslet array facing the display panel, the lenslet array comprising lenslets with spatially-varying prescriptions, such as different diameters, different focal lengths, and different asphere terms. The lenslet array further may be formed with a planar or non-planar substrate. The system further may include a distortion map comprising a set of transform matrices, each transform matrix configured to pre-distort a corresponding elemental image of a lightfield image so as to compensate for distortion expected to be introduced by a corresponding lenslet of the lenslet array, as well as a rendering component configured to modify the array of elemental images of a rendered lightfield using the distortion map to generate a modified lightfield image, and provide the modified lightfield image for display at the display panel for viewing via the lenslet array.

Near-eye display having lenslet array with reduced off-axis optical aberrations

A near-eye display system includes one or more non-planar display panels and a lenslet array to display a near-eye lightfield frame. The near-eye display system further includes a rendering component to render, based on a stereoscopic focus volume associated with a set of display geometry data of the one-or more non-planar display panels, the array of elemental images in the near-eye lightfield frame such that objects within the stereoscopic focus volume are perceived to be in focus by the user's eye. A method of operation of the near-eye display system includes receiving display geometry data for one or more non-planar display panels of the near-eye display system and rendering, based on a stereoscopic focus volume, an array of elemental images at a position within a near-eye lightfield frame such that the non-planar display panels presents objects within the stereoscopic focus volume to be in focus.

Non-planar computational displays

A near-eye display system includes an array of lenslets overlying a display panel. The display panel includes an array of light projecting elements, each light projecting element being coaxial with an axis of a corresponding lenslet. The display panel further includes an array of light detecting elements and an array of sub-pixel elements. The system further includes a control component configured to activate the array of light projecting elements to project a pattern of light spots toward an eye of the user and to control the array of light detecting elements to capture an image representing a reflection of the projected pattern of light spots from the eye. The system also includes an analysis component to determine displacements between expected positions and actual positions of at least a subset of light spots in the captured image, and to characterize the eye based on the displacements.

Near-eye display with frame rendering based on reflected wavefront analysis for eye characterization

A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a rendering component to position the array of elemental images within the near-eye lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using the eye tracking component, a first pose of the user's eye and determining a shift vector for an array of elemental images forming a near-eye lightfield frame based on the first pose of the user's eye. The method further includes rendering the array of elemental images at a position within the near-eye lightfield frame that is based on the shift vector.

Near-eye display with extended effective eyebox via eye tracking

A method of operation in a near-eye display system includes determining, using an eye tracking component of the near-eye display system, a pose of a user's eye. A shift vector is determined for a magnifier lens of the near-eye display system based on the pose of the user's eye, and the shift vector is communicated to an actuator of the near-eye display system to instruct translation of the magnifier lens relative to the user's eye. After translation of the magnifier lens, an array of elemental images is rendered at a position within a near-eye lightfield frame and communicated for display at a display panel of the near-eye display system.

Growing community of inventors

San Jose, CA, United States of America

Patrick Llull