Nvidia Corporation

Hewlett-Packard Development Company, L.p.

Aptina Imaging Corporation

Intel Corporation

Nethra Imaging Inc

Yining Deng

Eric Dujardin

D Amnon Silverstein

Sung Hyun Hwang

Hamidreza Mirzaei Domabi

Hugh Phu Nguyen

Animesh Khemka

Tong Zhang

Daniel R Tretter

Ramin Samadani

Qian Lin

David R Pope

Ullas Gargi

Minwoo Park

Jian Fan

Ping Wah Wong

Pere Obrador

Sean Midthun Pieper

Ken Kengkuan Lin

Eric Francois Xavier Dujardin

Abhinav Sinha

Apparatuses, systems, and techniques to perform effective tone management for image data. In an embodiment, a set of contrast gain curves are generated corresponding to a set of tonal ranges of an input image. An output image may then be generated by at least applying corresponding contrast gain curves to tonal ranges of the input image.

Tone management using tone gain functions for high dynamic range imaging applications

In various examples, apparatuses, systems, and techniques to perform offline image signal processing of source image data to generate target image data. In at least one embodiment, data collection using exposure and calibration setting of an image sensor is performed to generate source image data, which is then processed by using offline image signal processing to generate target data.

High dynamic range image processing with fixed calibration settings

In order to more accurately white balance an image, weightings can be determined for pixels of an image when computing an illuminant color value of the image and/or a scene. The weightings can be based at least in part on the Signal-to-Noise Ratio (SNR) of the pixels. The SNR may be actual SNR or SNR estimated from brightness levels of the pixels. SNR weighting (e.g., SNR adjustment) may reduce the effect of pixels with high noise on the computed illuminant color value. For example, one or more channel values of the illuminant color value can be determined based on the weightings and color values of the pixels. One or more color gain values can be determined based on the one or more channel values of the illuminant color value and used to white balance the image.

Weighted normalized automatic white balancing

The various embodiments of the present disclosure are directed towards methods for tone mapping High-Dynamic-Range (HDR) image data, as well as controlling the brightness of the image encoded by HDR the image data and/or the tone-mapped image data. HDR image is captured. A tone mapping function for the HDR image data is generated. To generate the tone mapping function, control points are dynamically determined based on an analysis of the HDR image data. The tone mapping function is fit to the control points. The tone mapping function is a non-linear function, and is described by a curve in a plane. The shape of the curve is constrained by a line generated from a portion of the control points. The tone mapping function is applied to the HDR image data. A color-compression is applied to the tone mapped image data to generate Standard Dynamic Range or Low Dynamic Range image data.

Enhanced high-dynamic-range imaging and tone mapping

Techniques are disclosed for identifying preferred orientations of a face in view of various preference factors and for producing a face image having a preferred orientation. The techniques allow a user to take a so-called selfie or have a video chat and appear as if he/she is looking into the camera with a face orientation that has been determined to be optimal for various factors. Such factors may be associated with face type (e.g., face shape, face color), image capture conditions (e.g., time of day, location, light condition, background), and/or the preferences of a particular user. The factors may also be directly associated with and/or dependent on face orientation (e.g., relative nostril size, facial symmetry, relative eye size, eye height).

Production of face images having preferred perspective angles

One embodiment of the present invention sets forth a technique for reducing flicker in image frames captured with a rolling shutter. A flicker detection and correction engine selects a first channel from a first image frame for processing. The flicker detection and correction engine subtracts each pixel value in the first channel from a corresponding pixel value in a prior image frame to generate a difference image frame. The flicker detection and correction engine identifies a first alternating current (AC) component based on a discrete cosine transform (DCT) associated with the difference image frame. The flicker detection and correction engine reduces flicker that is present in the first image frame based on the first AC component. One advantage of the disclosed techniques is that the flicker resulting from fluctuating light sources is correctly detected and reduced or eliminated irrespective of the frequency of the fluctuating light source.

DCT based flicker detection

An exemplary method for creating a composite image includes the steps of capturing a plurality of images with an image capture device which includes a sensor, determining an image capture device pose corresponding to each of the images based on data from the sensor, transforming each of the images based on its corresponding pose, projecting the transformed images to a common projection space, and combining the projected images to form a composite image.

Creating composite images based on image capture device poses corresponding to captured images

A method and apparatus for smoothing an image in a plurality of video frames consisting of a current frame and at least one previous frame. The position of at least one pixel in each of the plurality of frames is determined to provide respective determined positions. An adjusted position of the at least one pixel in the current frame is calculated based on the determined positions.

Method and apparatus providing motion smoothing in a video stabilization system

Lens cleaning warning systems and methods. A system includes an image processing unit configured to analyze image data to determine whether the image data indicates lens flare and, if so, provide an indication to the user that the lens is contaminated.

Lens cleaning warning system and method

An imaging device and methods of stabilizing video captured using a rolling shutter operation. Motion estimation is used to determine a row motion vector for individual rows of a current frame of a pixel array. The row motion vectors are used to map the location of pixels in the current frame to a mapped frame representing a single acquisition time for the current frame.

Methods and system for digitally stabilizing video captured from rolling shutter cameras

A method and system for blending images into a single image. Initially two images of a view are selected, wherein the images have overlapping content of the view. The images can differ from each other in such characteristics as time, camera location, camera settings, and lighting. The images are divided into strips along a common plane in a region of each image where the images overlap. A strip from each image is selected where the images are a close match. Pixel by pixel difference values between the two strips are calculated, and a cut line is determined where the differences between the two strips are minimized. Each image is cut along the corresponding cut line, and the cut images are blended together to form a single image of the view. The blended single image can be further processed by warping the image along the cut line to provide for a smoother fit between the two images.

System and method for blending images into a single image

A method performed by a processing system. The method includes receiving a sequence of frames, each frame comprising a sequence of at least two images, each image at a different image position in the sequence and each pair of adjacent images having an overlap region. A local alignment value is determined for the images of each pair of adjacent image positions of each frame based on minimizing a difference of a desired parameter between the images in the overlap region. Global alignment values are determined for all images at corresponding pairs of adjacent image positions of each frame based on the local alignment values for the images at the corresponding pair of adjacent image positions of each frame. Each global alignment value is applied to at least one image of the images of the corresponding pair of adjacent image positions of each frame.

Growing community of inventors

Fremont, CA, United States of America

Yining Deng