Qualcomm Incorporated

Shang-Chih Chuang

Xiaoyun Jiang

Jing Wang

Jiafu Luo

Narayana Karthik Ravirala

Shizhong Liu

Venkata Ravi Kiran Dayana

Yi-Chun Lu

Weiliang Liu

Pradeep Kumar Veeramalla

Ron Gaizman

Chung-Chi Tsai

Wei Zou

Ki Sun Song

Younsu Kim

Jun Zuo Liu

Srinath Anekere Narayan

Nyeongkyu Kwon

Sreevatsan Madhavan

Kuang-Jui Hsu

Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Image alignment for computational photography

Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Mechanical infrared light filter

A transformer may transform image data from a first color pattern to a second color pattern. The transforming of image data may be applied to image data received from a memory storing an array of intensities corresponding to a first color pattern of a first color filter array (CFA) of an image sensor to a second color pattern. The second color pattern may be a color pattern of a size smaller that the first CFA. Remosaicing may be applied to the second color pattern to obtain image data organized in a Bayer color pattern. The transforming may be configured to operate on data from an image sensor to obtain different zoom levels not available without applying a digital zoom algorithm that involve upscaling, which reduces the image quality of the image data.

Image data processing using non-integer ratio transforming for color arrays

The present disclosure relates to methods and apparatus for image processing. For example, disclosed techniques facilitate a sparse infrared pixel design for image sensors. Aspects of this disclosure include an image sensor including a pattern of pixels, the pattern of pixels including a set of visible light pixels and a set of infrared light pixels. The image sensor may be configured to generate visible light data and infrared light data based on received light. Aspects of the present disclosure also include a processor coupled to the image sensor. The processor may be configured to generate a configurable mask based on the pattern of pixels of the image sensor, and where values of the configurable mask correspond to pixel locations of the image sensor.

Sparse infrared pixel design for image sensors

Methods, systems, and devices for anchor frame switching in an imaging system are described. A device may generate a pixel map based on a set of frames. A first subset of frames of the set of frames have a first exposure and a second subset of frames of the set of frames have a second exposure different than the first exposure. The device may determine a region of the pixel map representing motion between at least two frames of the first set of frames. If the device determines that a quantity of motion pixels in the region is higher than a threshold, the device may select a short exposure frame as an anchor frame, beginning at a later frame. Otherwise, the device may maintain using a long exposure frame as the anchor frame.

Techniques for anchor frame switching

Methods, systems, and devices for minimizing ghosting in high dynamic range image processing are described. The method may include capturing from a sensor of the device a downscaled first frame of a first exposure length and a downscaled second frame of a second exposure length that is longer than the first exposure length, identifying a highlight region associated with the downscaled first frame and a motion region associated with the downscaled first frame and with the downscaled second frame, blending the motion region in accordance with determining whether at least a portion of the motion region overlaps the highlight region, and incorporating the blending of the motion region in a set of full resolution frames.

Minimizing ghosting in high dynamic range image processing

Systems, methods, and computer-readable media are provided for foreground image segmentation. In some examples, a method can include obtaining a first image of a target and a second image of the target, the first image having a first field-of-view (FOV) and the second image having a second FOV; determining, based on the first image, a first segmentation map that identifies a first estimated foreground region in the first image; determining, based on the second image, a second segmentation map that identifies a second estimated foreground region in the second image; generating a third segmentation map based on the first segmentation map and the second segmentation map; and generating, using the second segmentation map and the third segmentation map, a refined segmentation mask that identifies the target as a foreground region of the first and/or second image.

Segmentation for image effects

Aspects of the present disclosure relate to systems and methods for selectively processing tiles of a captured image. The captured image may be parsed into a plurality of tiles. A subset of the plurality of tiles may be selected based at least in part on at least one metric. The selected tiles may be processed according to a first technique, while each unselected tile may be selectively processed according to one or more techniques different from the first technique. The first technique and the one or more techniques may each be either an image demosaicing technique or an image denoising technique.

Tile-selection based deep demosaicing acceleration

Methods, systems, and devices for processing color information are described. The method may include receiving a first set of image data collected at an image sensor based on a first color filter array having a first filter pattern, calculating a color saturation gradient based on the first set of image data, and calculating multiple color gradients based on the color saturation gradient. The multiple color gradients may each be associated with a region of the first set of image data, where each color gradient characterizes a color variation along a different direction of the region. The method may include generating a second set of image data including a color value for the region based on comparing a first direction gradient of the multiple color gradients with a second direction gradient of the multiple color gradients. Color values associated with the regions may be mapped to a second color filter array.

Color filter array pattern conversion

In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.

Growing community of inventors

San Diego, CA, United States of America

Shang-Chih Chuang