Zoran Corporation

Csr Technology Inc.

Qualcomm Incorporated

Qualcomm Technologies, Inc.

Victor Pinto

Meir Tzur

Erez Galil

Eran Pinhasov

Dudi Vakrat

Itsik Dvir

Yuri Dolgin

Artemy Baxansky

Noam Korem

Shimon Pertsel

Ben-Zion Shaick

Alex Fishman

Michael Shalev

Diana Shaposhnik

Nir Strauss

Gal Ben-David

Ron Gaizman

Yonatan Shlomo Simson

Costia Parfenyev

Mark Gintsburg

Maksym Aslianskyi

Anatoly Gurevich

Yaakov Arie Zandman

Tzach Hadas

Eyal Raz

Neil David Feldman

The present disclosure generally relates to image processing. For example, aspects of the present disclosure include systems and techniques for performing spatial and temporal processing of image data. Certain aspects provide an apparatus for processing frame data. The apparatus generally includes a memory, and one or more processors coupled to the memory, the one or more processors configured to: perform a first noise reduction operation based on first frame data via a machine learning component to generate first processed frame data; generate first feedback data based on the first processed frame data; and perform, via the machine learning component, a second noise reduction operation based on second frame data and the first feedback data.

Image signal processor

Techniques and systems are provided for processing one or more frames or images. For instance, a process for determining exposure for one or more frames includes obtaining a motion map for one or more frames. The process includes determining, based on the motion map, motion associated with the one or more frames of a scene. The motion corresponds to movement of one or more objects in the scene relative to a camera used to capture the one or more frames. The process includes determining, based on the determined motion, a number of frames and an exposure for capturing the number of frames. The process further includes sending a request to capture the number of frames using the determined exposure duration.

Frame processing and/or capture instruction systems and techniques

A video encoder with an integrated temporal filter, which has an output carrying a sequence of encoded frames, includes: an input receiving input frame data; a temporal filter receiving the input frame data from the input and producing filtered frame data; motion processing modules receiving reconstructed frames derived from the sequence of encoded frames and the filtered frame data from the temporal filter and producing a residual error signal output; and a coder module which receives the input frame data and the residual error signal and produces the sequence of encoded frames. A method of encoding video includes: receiving a current frame to be encoded into a motion estimator and a temporal filter substantially at one time; receiving a previously encoded reference frame; generating a reconstructed motion-compensated reference frame from the previously encoded reference frame; and determining from the motion-compensated reference frame and the current frame whether and how much blending to perform between the motion compensated reference frame and the current frame.

Video encoder with an integrated temporal filter

A noise reduction apparatus for digital cameras is presented that includes groups of one or more connected non-linear filter units. Each of the filter unit groups are driven by decimated input image data at a different level of decimation and the output of at least one of these filter unit groups serves as one of a plurality of inputs to another filter unit group driven at a different decimation level. Filtered image data from one or more filter unit groups is adaptively combined in response to one or more image metrics related to one or more local regional image characteristics.

Advanced noise reduction in digital cameras

An integrated circuit (IC) includes a first power supply node that is arranged to receive a first power supply signal. The IC also includes process detection circuits. Each process detection circuit provides a process detection output signal such that a value associated with the process detection output signal is a function of process variation at a location of the process detection circuit outputting the process detection signal. The IC also includes a processing unit that executes processor-executable instructions to provide at least one voltage control signal, based, at least in part, on the process detection signals. The voltage control signal(s) include a first voltage control signal is associated with a target voltage for the first power supply signal.

Method and apparatus for dynamic power management

Methods and the corresponding device are presented for the correction of lateral chromatic aberration within a digital camera or other imaging device, using calibration approaches that do not require previously acquired lens data to effect the correction. An in-camera auto-calibration procedure is performed on the attached lens, such as when a lens is exchanged, and extracts parameters required for chromatic aberration correction, respecting zoom and focus, from one or more captured images. Based on image data extracted as a plurality of channels of a chromatic decomposition of the image, the chromatic aberration information for the lens is extracted. From the chromatic aberration information, the correction factors for the lens are determined.

Optical chromatic aberration correction and calibration in digital cameras

Embodiments are directed towards compressing an image to substantially a preset file size using statistical information obtained from a single subset of the image and an initial compression of the single subset. A representative subset portion of the image is selected based in part on a clustering analysis of the image. The representative subset is then compressed, in one embodiment, twice, in order to obtain statistics useable for the entire image. A scale factor is then determined that may be used in the quantization and for creating a Bit Rate Control (BRC) curve that represents an amount of accumulated bits per Minimal Codec Unit (MCU). During the compression process, the BRC curve is used to prevent accumulating bits from over shooting a final preset file size target.

Zero pass JPEG bit rate controller

Methods for estimating illumination parameters under flickering lighting conditions are disclosed. Illumination parameters, such as phase and contrast, of a intensity-varying light source may be estimated by capturing a sequence of video images, either prior to or after a desired still image to be processed. The relative average light intensities of the adjacently-captured images are calculated and used to estimate the illumination parameters applicable to the desired still image. The estimated illumination parameters may be used to calculate the point spread function of a still image for image de-blurring processing. The estimated illumination parameters may also be used to synchronize the exposure timing of a still image to the time when there is the most light, as well as for use in motion estimation during view/video modes.

Image processing under flickering lighting conditions using estimated illumination parameters

A device and methods are provided for producing a high dynamic range (HDR) image of a scene are disclosed and claimed. In one embodiment, method includes setting an exposure period of an image sensor of the digital camera and capturing image data based on the exposure period. The method may further include checking the image data to determine whether the number of saturated pixels exceeds a saturation threshold and checking the image data to determine whether the number of cutoff pixels exceeds a cutoff threshold. The method may further include generating a high dynamic range image based on image data captured by the digital camera, wherein the high dynamic range image is generated based on a minimum number of images to capture a full dynamic range of the scene.

Exposure control for high dynamic range image capture

A method and device are provided for method for stabilization of image data by an imaging device. In one embodiment, a method includes detecting image data for a first frame and a second frame, performing motion estimation to determine one or more motion vectors associated with global frame motion for image data of the first frame, performing an outlier rejection function to select at least one of the one or more motion vectors, and determining a global transformation for image data of the first frame based, at least in part, on motion vectors selected by the outlier rejection function. The method may further include determining a stabilization transformation for image data of the first frame by refining the global transformation to correct for unintentional motion and applying the stabilization transformation to image data of the first frame to stabilize the image data of the first frame.

Method and apparatus for image stabilization

The likelihood of a particular type of object, such as a human face, being present within a digital image, and its location in that image, are determined by comparing the image data within defined windows across the image in sequence with two or more sets of data representing features of the particular type of object. The evaluation of each set of features after the first is preferably performed only on data of those windows that pass the evaluation with respect to the first set of features, thereby quickly narrowing potential target windows that contain at least some portion of the object. Correlation scores are preferably calculated by the use of non-linear interpolation techniques in order to obtain a more refined score. Evaluation of the individual windows also preferably includes maintaining separate feature set data for various positions of the object around one axis and rotating the feature set data with respect to the image data for the individual windows about another axis.

Detecting objects in an image being acquired by a digital camera or other electronic image acquisition device

Video data that includes a plurality of images acquired over time are processed in an apparatus immediately after acquiring the video data, or during some later post-processing of the video data, to reduce the effects of unintended motion in the acquired images. Coarse and fine compensation for motion is performed on video frames that correspond to the acquired images. A coarse compensation value is employed to compress each video frame that is both coarse and fine motion compensated.

Processing of video data to compensate for unintended camera motion between acquired image frames

A digital camera captures successive first and second images using an image sensor to produce image data, and processes the image data of the successive first and second images. The processing of the second image overlaps processing of the first image in time. The processing of the two images includes mapping locations in a virtual memory space to locations in the memory pages in a physical memory space of the digital camera, and storing information corresponding to the mapped locations in a page table. The digital camera performs operations on the image data of the first and second images stored at specified locations in the virtual memory space, and while performing those operations allocates and de-allocates memory pages in the physical memory space to virtual memory pages in the virtual memory space and updates the page table accordingly.

Digital camera with virtual memory

Techniques for modifying data of an image that can be implemented in a digital camera, video image capturing device and other optical systems are provided to correct for Image image shading variations appearing in data from a two-dimensional photo-sensor. These variations can be caused by imperfect lenses, non-uniform sensitivity across the photo-sensor, and internal reflections within a housing of the optical system, for example. In order to correct for these variations, a small amount of modification data is stored in a small memory within the camera or other optical system, preferably separate correction data for each primary color. Image data from individual pixels are corrected on the fly by interpolating individual pixel corrections from the stored modification data, at the same rate as the image data is being acquired, so that the correction takes place without slowing down data transfer of picture data from the image sensor.

Growing community of inventors

Zychron-Yaakov, Israel

Victor Pinto