Qualcomm Incorporated

Capsovision Inc.

Ess Technology, Inc.

Wang, Kang-huai

Wilson, Gordon

Luo, Jiafu

Lee, Chung-ta

Jiafu Luo

Kang-Huai Wang

Gordon Cook Wilson

Xiaoyun Jiang

Chung-Ta Lee

Jing Wang

Sergiu Radu Goma

Micha Galor Gluskin

Biay-Cheng Hseih

Shang-Chih Chuang

Narayana Karthik Ravirala

Wesley James Holland

Richard Arthur Mann

Shizhong Liu

Venkata Ravi Kiran Dayana

Selim Bencuya

James Blanc

Ji Soo Lee

Silei Ma

Chia-Yuan Teng

Hau Hwang

Chinchuan Andrew Chiu

Jisoo Lee

Robert Lynn Blair

Mehmet Ali Tan

Karthikeyan Shanmugavadivelu

Weiliang Liu

Pradeep Kumar Veeramalla

Ho Sang Lee

Zeynep Toros

Wenbin Wang

Loic Francois Segapelli

Ron Gaizman

Songhe Cai

Scott Cheng

Rohan Desai

Lee-Kang Liu

Zuguang Xiao

Max Safai

Wei Zou

Abhay Raut

Krishnam Indukuri

Rakesh Sanam

Peng Lin

Alexandre G Grigoriev

Heng Zhang

Miaohong Shi

Chi-Shao (Sergi) Lin

Srinath Anekere Narayan

Jianyou Li

Pradeep Veeramalla

Systems and methods for image fusing are described. In examples, a first image of a scene may be obtained associated with a first parameter and a second image of the scene may be obtained associated with a second parameter. The first image and the second image may be fused to obtain at least one first fused image. A third image of the scene may be obtained associated with a third parameter and a fourth image of the scene may be obtained associated with a fourth image. At least one parameter associated with the third image and the fourth image used to obtain the images may be adjusted, wherein the adjustment may be based at least in part on a field of view of the at least one first fused image. The third image and the fourth image may be fused to obtain a second fused image.

Method and apparatus for image capturing

Systems, methods, and computer-readable media are provided for low power, variable focus. An example method can include obtaining, based on a trigger, a first image of a scene captured by an image sensor, the first image being captured with a lens of the image sensor in a first configuration of a plurality of available lens configurations; determining, based on the first image and a first detection result, whether an object of interest is present in the first image; in response to determining that the object of interest is not present in the first image, adjusting the lens to a second configuration selected from the plurality of lens configurations; obtaining, by the image sensor, a second image of the scene while the lens is in the second configuration; and determining, based on the second image and a second detection result, that the object of interest is present in the second image.

Low power object detection

This disclosure provides systems, methods, and devices for image signal processing that support improved detail keeping in photography through increased dynamic range and/or highlight-keeping. The image signal processing may be performed on data received from a split-pixel image sensor with two sets of sensor elements with different sensitivities. The image signal processing may include receiving image data comprising: first data from a first set of sensor elements and second data from a second set of sensor elements capturing a representation of the scene with a different sensitivity that the first set of sensor elements; determining an output dynamic range for an output image frame; and determining an output image frame based on at least one of the first data and the second data and based on the output dynamic range. Other aspects and features are also claimed and described.

Image sensor and data processing for parallel frame capture in high dynamic range (HDR) photography

This disclosure provides systems, methods, and devices for image signal processing. In a first aspect, a method of image processing includes controlling an image sensor to capture image data for determining a standard dynamic range (SDR) representation of a scene, the image data comprising a first series of image frames captured with a first exposure level and a second series of image frames captured at a second exposure level. The SDR representation of the scene may be generated by determining a first output image frame based on at least a first image frame of the first series of image frames. Determining of an exposure level for the image sensor during the SDR image capture may be based on a second image frame of the second series of image frames captured by the image sensor in a multi-frame sensor configuration. Other aspects and features are also claimed and described.

Multi-frame auto exposure control (AEC)

Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Multi-sensor imaging color correction

Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Systems and methods for controlling an image sensor

Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Image alignment for computational photography

Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Mechanical infrared light filter

Techniques and systems are provided for processing image data. For example, an image signal processor can obtain (e.g., from a host processor) a first setting change indicator value indicating a change in parameter settings of the image signal processor. The image signal processor can obtain an image frame from an image sensor, and can determine a second setting change indicator value from the image frame. The second setting change indicator value can be provided to the image sensor from the host processor. The second setting change indicator value indicates a change in parameter settings of the image sensor. The image signal processor can compare the first setting change indicator value to the second setting change indicator value, and can determine whether to process the image frame or to drop the image frame based on comparing the first setting change indicator value to the second setting change indicator value.

Synchronization mechanism for image capture and processing systems

Techniques and systems are provided for providing a rendering engine model for raw media data. In some examples, a system obtains media data captured by a data capturing device and embeds, in a media item containing the media data, a rendering engine model including a description of a neural network configured to process the media data and generate a particular media data output, the description defining a neural network architecture for the neural network. The system then outputs the media item with the rendering engine model embedded in the media item, the rendering engine model indicating how to execute the neural network to process the media data in the media item and generate the particular media data output based on the description of the neural network.

Embedded rendering engine for media data

A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that at least a portion of the secondary coil is enclosed by the primary coil and the battery is outside the primary coil when the capsule device is at the docked position.

Docking system with inductive powering for capsule camera

A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that the primary coil is wrapped around at least a portion of the primary core.

In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.

Combined monochrome and chromatic camera sensor

Systems and methods for synchronizing frame captures for cameras with different fields of capture are described. An example device includes a first camera and second camera. The first camera includes a first camera sensor and a first rolling shutter. The first camera is configured to prevent scanning pixels from a first row to a row n of the first camera sensor and configured to begin sequentially scanning pixels of the row n of the first camera sensor. The second camera includes a second camera sensor and a second rolling shutter. The second camera is configured to begin sequentially scanning pixels of a first row of the second camera sensor concurrently with beginning to sequentially scan pixels of the row n of the first camera sensor. The first row of the second camera sensor corresponds to a row within a predefined number of rows after the first camera sensor's row n.

Synchronization of frame captures from multiple cameras with different fields of capture

A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, an optical transmitter all enclosed in a capsule housing. The docking device comprises a primary coil to generate an alternating magnetic field, a primary core and optical receiver to receive an optical signal. The alternating magnetic field is coupled to the secondary coil to supply power to the capsule device when the capsule device is at a docked position in the docking device. The primary core is arranged to concentrate the alternating magnetic field on the secondary coil when the capsule device is at the docked position. Furthermore, the capsule endoscopic system is arranged so that an optical path is formed between the optical transmitter and the optical receiver when the capsule device is at the docked position.

Optical docking system with inductive powering for capsule camera

Growing community of inventors

Irvine, CA, United States of America

Jiafu Luo