Waymo LLC

Google Inc.

Ignacio Garcia Dorado

Damien Kelly

Xiaoying He

Jia Feng

Chia-Kai Liang

Peyman Milanfar

Bartlomiej Maciej Wronski

Nirav Dharia

Benjamin Frevert

Yi Hung Chen

Yi Chun Chen

The present disclosure describes systems and techniques for creating a super-resolution image () of a scene captured by a user device (). Natural handheld motion () introduces, across multiple frames () of an image of a scene, sub-pixel offsets that enable the use of super-resolution computations () to form color planes (), which are accumulated () and combined () to create a super-resolution image () of the scene.

Super-resolution using natural handheld-motion applied to a user device

Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.

Systems, apparatus, and methods for retrieving image data of image frames

Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.

Systems, apparatus, and methods for generating enhanced images

The present disclosure describes systems and techniques directed to optical image stabilization movement to create a super-resolution image of a scene. The systems and techniques include a user device () introducing (), through an optical image stabilization system (), movement to one or more components of a camera system () of the user device (). The user device () then captures () respective and multiple frames () of an image of a scene, where the respective and multiple frames () of the image of the scene have respective, sub-pixel offsets of the image of the scene across the multiple frames () as a result of the introduced movement to the one or more components of the camera system (). The user device () performs (), based on the respective, sub-pixel offsets of the image of the scene across the respective, multiple frames (), super-resolution computations and creates () the super-resolution image of the scene based on the super-resolution computations.

Optical image stabilization movement to create a super-resolution image of a scene

Growing community of inventors

Mountain View, CA, United States of America

Ignacio Garcia Dorado