Qualcomm Incorporated

Ying Noyes

Szepo Robert Hung

Ruben Manuel Velarde

Jingqiang Li

Ho Sang Lee

Chinchuan Andrew Chiu

Xiaoyun Jiang

Shuxue Quan

Micha Galor Gluskin

Hengzhou Ding

Liang Liang

Loic Francois Segapelli

Lee-Kang Liu

Haiyin Wang

Babak Forutanpour

Kalin Mitkov Atanassov

Yingyong Qi

Hsiang-Tsun Li

Thomas Wesley Osborne

David L Bednar

Aravind Bhaskara

Leung Chun Chan

Wenbin Wang

Nan Cui

Tao Shen

Wenbiao Wang

Kyuseo Han

Wei Zou

Jun Liu

Rengaraj Thirupathi

Yonggui Mao

Balakrishna Mandadi

Yiqian Wang

Edward G Atrero

A device for image capture comprises a memory and one or more processors coupled to the memory and configured to: receive, during a preview mode or a recording, a first image, generate a first saliency map indicative of relative saliency of different regions within the first image, wherein the relative saliency of the different regions is indicative of a likelihood of attracting viewer gaze, generate one or more additional images based on manipulating pixels in the first image, generate one or more additional saliency maps indicative of relative saliency of different regions within the one or more additional images, and determine, during the preview mode or the recording, a camera setting based on the first saliency map and the one or more additional saliency maps.

Saliency based capture or image processing

Methods, devices, and systems for determining image capture settings based on an audio input are disclosed. In some aspects, a device includes a memory, a camera including a lens and a sensor, and a processor coupled to the camera and the memory. The processor may be configured to receive an audio input, determine contextual information based on the audio input, determine one or more image capture settings based on the contextual information, and output the one or more image capture settings.

Audio based image capture settings

Methods, systems, and devices for operating a camera-enabled device are described. The camera-enabled device may emit, via a first light emitting source, an infrared light in a physical environment and determine time-of-flight information associated with a target object in the physical environment based on the emitted infrared light. The camera-enabled device may estimate one or more exposure settings based on the time-of-flight information, and emit, via a second light emitting source, a visible light in the physical environment based on the estimated one or more exposure settings. As a result, the camera-enabled device may capture an image of the physical environment based on the emitted visible light and the estimated one or more exposure settings.

Infrared-assisted pre-flash

Aspects of the present disclosure relate to systems and methods for decorrelating one or more saturated regions of an image. In one example, a first phase image and a corresponding second phase image may be obtained. One or more saturated regions of the first phase image and second phase image may be determined. A weight may be applied to each pixel in the one or more saturated regions of the first and second phase images may be weighted to generate a weighted first phase image and a weighted second phase image, and one or more image processing operations may be performed on the weighted first and second phase images.

Image processing for saturated pixels

A method and apparatus for determining an auto white balance (AWB) gain based on determined depth information. The method may include receiving an image captured by an image sensor, determining depth information associated with the captured image, assigning weights to a plurality of illuminants based on the determined depth information, determining an auto white balance gain based on the assigned weights and statistics of the captured image, and applying the auto white balance gain to the captured image.

Depth assisted auto white balance

An image capture device that includes an adjustment circuit configured to monitor image parameters, generate updated image settings for the image capture device in response to the monitored image parameters, and transmit the updated image settings to one or more processors. The updated image settings configure the one or more processors to determine whether to transition the image capture device from a dynamic scene mode to a static scene mode based on a first image parameter included in the monitored image parameters, wherein the first image parameter is different from a second image parameter used to determine to transition the image capture device from the static scene mode to the dynamic scene mode, and to suspend generation of all or less than all of the updated image settings in response to determining to transition the image capture device from the dynamic scene mode to the static scene mode.

Power saving techniques for an image capture device

An apparatus and method of generating a zoomed image is disclosed. A particular method includes receiving an instruction to perform a zoom operation. Window information is sent to an image sensor based on the instruction. The window information corresponds to a portion of the image sensor. In addition, a request to reduce the pixel clock rate may be sent to the image sensor. The request may cause the image sensor to reduce the pixel clock rate such that a frame rate of image data captured by the image sensor is maintained. Cropped image data corresponding to the portion of the image sensor is received. The cropped image data is upscaled to generate a zoomed image.

Generating a zoomed image

This disclosure describes techniques for improving functionalities of a back-end device, e.g., a video encoder, using parameters detected by a front-end device, e.g., a video camera. The techniques may involve detecting a scene change in a captured frame, based on one or more parameters of auto exposure (AE), auto white balance (AWB), and auto focus (AF) functions. If a scene change is detected in a captured frame, a video processing device, which may be a stand-alone device, or may be integrated into one of the front-end or back-end devices, provides an indication of the scene change. The video encoder interprets the signal as a trigger to encode the frame indicated as the frame where a scene change occurred as a reference I frame.

Camera parameter-assisted video encoding

An example image capture device determines a region of interest using a first image captured while a light source is powered off and a second image captured while a light source is powered on and uses the region of interest to automatically set configurations. In one example, an image capture device includes a controlled light source, an image sensor configured to capture images, and a processing unit configured to cause the image sensor to capture a first image of a scene while the controlled light source is powered off, cause the image sensor to capture a second image of the scene while the controlled light source is powered on, calculate luminance differences between a plurality of regions in the first image and a plurality of collocated regions in the second image, and determine that a region of interest includes those regions for which the luminance differences exceed a threshold.

Region of interest extraction

Apparatus are provided including an image signal carrier, a luminance information evaluator, and a chrominance information modifier. The image signal carrier is encoded with an image signal including luminance information and chrominance information. The luminance information evaluator evaluates the luminance information in the image signal for a given region within the image to identify when the given region is one of substantially white and substantially dark. The chrominance information modifier is provided to modify the chrominance information corresponding to the given region when the given region is one of substantially white and substantially dark.

Chroma supression features

An apparatus and method of processing images is disclosed. In a particular embodiment, the method includes receiving a selection of a first image from a plurality of images stored at a memory device and displaying the first image. The method also includes receiving image modification data to modify processing of the first image displayed and providing an adjusted value of an image processing parameter to an image processor. The adjusted value of the image processing parameter is determined based at least in part on the image modification data.

Apparatus and method of processing images based on an adjusted value of an image processing parameter

A camera system in normal mode and hand jitter reduction (hjr) mode may comprise generating a first exposure time-gain product by multiplying the normal mode exposure time with the normal mode gain. It may further comprise modifying the normal mode exposure time and gain and multiplying these modified parameters to generate a second exposure time-gain product for a hjr mode that reduces the difference between the first exposure time-gain product and the second exposure time-gain product. To reduce the difference the normal mode frame rate may also be modified. Operation of a camera in normal mode may be in response to a sensed light level being above a threshold. The hjr mode may be selected by the user while the camera is operating. The hjr mode may be used in response to a sensed light level being lower than the threshold.

Hand jitter reduction system for cameras

The disclosure describes flicker detection and correction techniques to improve the quality of captured imagery, such as video or still images. In particular, this disclosure describes flicker correction techniques that compare different image frames to detect flicker. In some embodiments, the comparisons involves summing intensity values associated with rows within the frames and comparing the row sums to generate a difference signal. Detection and correction of flicker may be performed using a first derivative of the difference signal. The first derivative of the difference signal can be used in variety of ways to detect and correct flicker.

Automatic flicker correction in an image capture device

An imaging system generates a gain for a component of an image format. The gain is at least partially dependent on the brightness of the light source illuminating a scene when an image of the scene was generated. The gain can be used to correct the component of the image format for the color shift in the image caused by the light source. In some instances, the imaging system generates a gain for a plurality of the components of the image format or for all of the components of the image format. The gains can be used to correct the components for the color shift in the image caused by the light source.

Adaptive auto white balance

The registration of images comprising generating a plurality of projections from a base frame and generating a plurality of projections from a movement frame. Comparing a set of projections from the base frame, with a second set of projections from the movement frame, and generating a global motion vector estimate to add to the base frame.

Growing community of inventors

San Diego, CA, United States of America

Ying Noyes