Google Inc.

Lytro, Inc.

Chia-Kai Liang

Colvin Pitts

Kurt Akeley

Yi-Ren Ng

Fuhao Shi

Timothy James Knight

Xue Tu

Peyman Milanfar

Ignacio Garcia Dorado

Bartlomiej Maciej Wronski

Bennett Wilburn

David John Evans, V

Brian Keith Cabral

Wei Hong

Ming-Hsuan Yang

Graham Butler Myhre

Erik Gross

Jianing Wei

Carl Warren Craddock

Jiangtao Kuang

Kayvon Fatahalian

Kent Oberheu

Senpo Hu

Shengyi Lin

Nikhil Karnad

Radford Ray Juang

Kira Wampler

Kristen Berman

Carl (Warren) Craddock

Yichang Shih

Yi Hung Chen

Lun-Cheng Chu

Ryhor Karpiak

Eric Cheng

Youyou Wang

Garrett Girod

Wei-Sheng Lai

Francis A Benevides

Siargey Pisarchyk

Ion Bita

Brendan Elwood Bevensee

Sangmoo Choi

Yi Chun Chen

Jason Luke Wilson

Jyothi Karri

Zejing Wang

Michael Adkins Knott

Alex Song

Brendan Bevensee

Mugur Marculescu

YiChang Shih

An apparatus includes a display panel having a first pixel area having a first pixel density and a second pixel area having a second pixel density higher than the first, the panel configured to generate images viewable from a front side and a sensor positioned at the back side arranged to receive incident light transmitted from the front to the back through the first pixel area. The first pixel area has light emitting pixels and signal lines electrically connecting pixel circuits associated with the pixels, and the panel includes a layer having a light blocking material patterned to provide apertures to transmit the incident light between some of the light emitting pixels and the signal lines and to block the incident light from the pixel circuits and the signal lines. Apertures can have different dimensions.

Suppressing scattering of light transmitted through OLED displays

Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.

Real time perspective correction on faces

The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.

Stabilizing video by accounting for a location of a feature in a stabilized view of a frame

The present disclosure describes systems and techniques for creating a super-resolution image () of a scene captured by a user device (). Natural handheld motion () introduces, across multiple frames () of an image of a scene, sub-pixel offsets that enable the use of super-resolution computations () to form color planes (), which are accumulated () and combined () to create a super-resolution image () of the scene.

Super-resolution using natural handheld-motion applied to a user device

Methods, systems, and apparatus, including computer programs stored on a computer-readable storage medium, for video stabilization. In some implementations, a computer system obtains frames of a video captured by a recording device using an optical image stabilization (OIS) system. The computing system receives (i) OIS position data indicating positions of the OIS system during capture of the frames, and (ii) device position data indicating positions of the recording device during capture of the frames. The computing system determines a first transformation for a particular frame based on the OIS position data for the particular frame and device position data for the particular frame. The computing system determines a second transformation for the particular frame based on the first transformation and positions of the recording device occurring after capture of the particular frame. The computing system generates a stabilized version of the particular frame using the second transformation.

Video stabilization

The present disclosure describes systems and techniques directed to optical image stabilization movement to create a super-resolution image of a scene. The systems and techniques include a user device () introducing (), through an optical image stabilization system (), movement to one or more components of a camera system () of the user device (). The user device () then captures () respective and multiple frames () of an image of a scene, where the respective and multiple frames () of the image of the scene have respective, sub-pixel offsets of the image of the scene across the multiple frames () as a result of the introduced movement to the one or more components of the camera system (). The user device () performs (), based on the respective, sub-pixel offsets of the image of the scene across the respective, multiple frames (), super-resolution computations and creates () the super-resolution image of the scene based on the super-resolution computations.

Optical image stabilization movement to create a super-resolution image of a scene

Apparatus and methods related to image processing are provided. A computing device can determine a first image area of an image, such as an image captured by a camera. The computing device can determine a warping mesh for the image with a first portion of the warping mesh associated with the first image area. The computing device can determine a cost function for the warping mesh by: determining first costs associated with the first portion of the warping mesh that include costs associated with face-related transformations of the first image area to correct geometric distortions, and determining second costs associated with the warping mesh that include costs of edge-related transformations for preserving straightness of edges of the image. The computing device can determine an optimized mesh based on optimizing the cost function. The computing device can modify the first image area based on the optimized mesh.

Perspective distortion correction on faces

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for multi-camera video stabilization. In some implementations, a video capture device has a first camera and a second camera. The video capture device provides a digital zoom capability permitting user-specified magnification changes within a digital zoom range during video recording. The video capture device is configured to use video data from different cameras over different portions of the digital zoom range. The video capture device can process image data captured using the second camera by applying a set of transformations including (i) a first transformation to a canonical reference space for the second camera, (ii) a second transformation to a canonical reference space for the first camera, and (iii) a third transformation to apply electronic image stabilization to image data in the canonical reference space for the first camera.

Multi-camera video stabilization

Implementations generally relate to locking a camera onto a sub-region to capture images of the sub-region with a moving camera. In some implementations, a method includes determining a first region in a scene detected by a camera while the camera is in a first physical position. The method further includes receiving user input to target a sub-region within the first capture region of the scene and capturing the first image of the sub-region while the camera is in the first physical position. The first image is displayed in a fixed orientation on a preview portion of a display screen. The camera is moved to a second physical position and a second capture region of the scene is detected. The method further includes capturing a second image is of the sub-region and displaying it in the fixed orientation on the preview portion of the display screen. The second image is effective to inform a user of whether capture of the sub-region is altered by camera movement.

Camera area locking

Growing community of inventors

San Jose, CA, United States of America

Chia-Kai Liang