Qualcomm Incorporated

Lee-Kang Liu

Micha Galor Gluskin

Jisoo Lee

Ying Noyes

Wenbin Wang

Jiafu Luo

Shizhong Liu

Weiliang Liu

Ho Sang Lee

Loic Francois Segapelli

Zuguang Xiao

Nan Cui

Silei Ma

Hailong Wang

Balakrishna Mandadi

Yiqian Wang

This disclosure provides systems, methods, and devices for image signal processing. In a first aspect, a method of image processing includes controlling an image sensor to capture image data for determining a standard dynamic range (SDR) representation of a scene, the image data comprising a first series of image frames captured with a first exposure level and a second series of image frames captured at a second exposure level. The SDR representation of the scene may be generated by determining a first output image frame based on at least a first image frame of the first series of image frames. Determining of an exposure level for the image sensor during the SDR image capture may be based on a second image frame of the second series of image frames captured by the image sensor in a multi-frame sensor configuration. Other aspects and features are also claimed and described.

Multi-frame auto exposure control (AEC)

A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Saliency based capture or image processing

Methods, systems, and apparatuses are provided that adapt image capture operations to provide refined image capture capabilities. For example, an image capture device captures image data from a sensor operating at a first binning level. The image capture device receives a desired level of zoom, and determines whether the sensor is to be transitioned from the first binning level to a second binning level based on a binning transition threshold. If the sensor is to be transitioned, the image capture device adjusts one or more image capture operations, such as auto focus, automatic exposure, automatic gain, or automatic white balance, based on the desired level of zoom. After an amount of time, the image capture device transitions the sensor from the first binning level to the second binning level. The image capture device then captures image data from the sensor operating at the second binning level.

Apparatus and methods for image capture control

A method synchronizes autofocus in a system having a master camera and a slave camera. The method comprises: focusing the slave camera based on a map and a result of an autofocus operation by the master camera, while capturing each of a plurality of images. The map relates a plurality of master camera lens positions of the master camera to corresponding slave camera lens positions of the slave camera. An autofocus operation is periodically performed in the slave camera to determine an additional slave camera lens position for an additional image. The map is adaptively updated, based at least partially on the additional slave camera lens position.

Multi-camera autofocus synchronization

Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Image processing for saturated pixels

Aspects of the present disclosure relate to systems and methods for hybrid depth map processing. An example device may include a first sensor having a plurality of focus pixels, the focus pixels configured to capture images from at least a first perspective and a second perspective, where a difference between the first and second perspectives is associated with a first direction. The device may further include a second image sensor separated from the first image sensor in a second direction orthogonal to the first direction. The device may be configured to receive a first image from the first image sensor, where the first image includes first image data captured from the first perspective, and second image data captured from the second perspective. The device may be further configured to receive a second image from the second image sensor, and to generate a hybrid depth map based at least in part on the first image and the second image.

Growing community of inventors

San Diego, CA, United States of America

Lee-Kang Liu