Google Inc.

Verily Life Sciences LLC

John D Perreault

Patrick Llull

Seung Ah Lee

Supriyo Sinha

Victor Marcel Acosta

Chinmay Belthangady

Cheng-Hsun Wu

James Michael Higbie

Suresh Alla

Andrew Gerrit Huibers

Daniele Paolo Piponi

Tamara Troy

Faisal Mahmood Kashif

Brian M Rabkin

Adam Backer

Brion Koprowski

Johnny Hsienchow Lee

Evan Mark Richards

Jonathan J Huang

Mark B Spitzer

Serge J Bierhuizen

Eden Rephaeli

Andrew Homyk

Adrian Wong

Justin S Legakis

Oscar A Martinez

Xinda Hu

Yi Qin

Jerry Carollo

Khoa Nguyen

Techniques of calibrating telepresence videoconferencing displays and cameras include providing 6 DoF camera locations and orientation vectors in display reference frame based on a plurality of images that indicate specified mirror-plane points of a mirror and specified reflected display plane points. In some implementations, the specified mirror-plane points are located at fiducial markers printed on the mirror. In some implementations, the specified reflected display plane points are located in a checkerboard pattern of fiducial markers on the display.

Accurate camera-display calibration for telepresence videoconferencing

An autostereoscopic display system includes a transmissive display panel including a backlight having an array of backlight pixels, a selectively-selectively-transmissive display pixel matrix having a first side facing the backlight and an opposing second side, the selectively-transmissive display pixel matrix comprising an array of display pixels, a first lenticular array disposed between the backlight and the first side of the selectively-transmissive display pixel matrix, and a second lenticular array disposed facing the second side of the selectively-transmissive display pixel matrix. The backlight is configured to separately activate different subsets of the backlight pixels such that light emitted from an activated subset of backlight pixels and transmitted through the first lenticular array, the selectively-transmissive display pixel matrix, and the second lenticular array is emitted by the display panel as display light in a corresponding separate direction relative to the display panel.

Multiview autostereoscopic display using lenticular-based steerable backlighting

A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.

Viewing-angle-dependent color/brightness correction for display system

A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.

Near-eye display with extended accommodation range adjustment

The present disclosure relates to systems and methods for cellular imaging and identification through the use of a light sheet flow cytometer. In one implementation, a light sheet flow cytometer may include a light source configured to emit light having one or more wavelengths, at least one optical element configured to form a light sheet from the emitted light, a microfluidic channel configured to hold a sample, and an imaging device. The imaging device may be adapted to forming 3-D images of the sample such that identification tags attached to the sample are visible.

Light sheet imaging flow cytometer

A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.

Beam steering optics for near-eye and head mounted displays

A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.

Beam steering optics for virtual reality systems

A near-eye display system includes a display panel to emit display light representative of a display image and a lens assembly disposed along an optical axis. The lens assembly includes a first phase mask plate having a first major surface facing the display and a second major surface opposite the first major surface, the second major surface implementing a first freeform Fresnel lens structure, and further includes a second phase mask plate adjacent and parallel to the first phase mask plate and having a third major surface facing the second major surface and an opposing fourth majors surface, the third major surface implementing a second freeform Fresnel lens structure. A pose of at least one of the first and second phase mask plates relative to the other is configured to be adjusted so as to adjust an optical power of the lens assembly.

Fresnel-based varifocal lens assembly for VR or AR displays

A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.

Augmented reality light field head-mounted displays

A method includes capturing an image of a lenticular display, generating a lenticular distortion map of the lenticular display using the image, and compensating for a lenticular distortion of the lenticular display using the lenticular distortion map. The lenticular distortion map is a dual-component lenticular distortion map and the image is a fringe pattern. The method compensates for the lenticular distortion by adjusting a swizzle function based on the lenticular distortion map.

Method and apparatus for correcting lenticular distortion

A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.

Active LCD shutters for virtual and augmented reality low persistence

A near-eye display system includes display panel to display a near-eye lightfield frame comprising an array of elemental images and a lenslet array to present the integral lightfield frame to a user's eye. The system further includes a rendering component to generate an array of elemental images based at least in part on a sparse sampling of a source image to decrease an overlap of image data contained within each individual elemental of the array of elemental images. A method of operation of the near-eye display system includes generating an array of elemental images forming the integral lightfield frame based on a sparse sampling of the current viewpoint of the subject object to decrease an overlap of image data contained within each individual elemental image of the array.

Near-eye display with sparse sampling super-resolution

A near-eye display system includes a display panel to display a lightfield image comprising an array of elemental images and a lenslet array facing the display panel, the lenslet array comprising lenslets with spatially-varying prescriptions, such as different diameters, different focal lengths, and different asphere terms. The lenslet array further may be formed with a planar or non-planar substrate. The system further may include a distortion map comprising a set of transform matrices, each transform matrix configured to pre-distort a corresponding elemental image of a lightfield image so as to compensate for distortion expected to be introduced by a corresponding lenslet of the lenslet array, as well as a rendering component configured to modify the array of elemental images of a rendered lightfield using the distortion map to generate a modified lightfield image, and provide the modified lightfield image for display at the display panel for viewing via the lenslet array.

Growing community of inventors

Mountain View, CA, United States of America

John D Perreault