Apple Inc.

Flashpoint Technology, Inc.

Pixim, Incorporated

David Daming Kuo

Haitao Guo

Ting Chen

Andrew Yanowitz

Hsi-Jung Wu

Elizabeth Caroline Cranfill

Eric C Anderson

Guy Cote

Xiaosong Zhou

Joe S Abuan

Hyeonkuk Jeong

James O Normile

Michael G Frank

Ricardo Jansson Motta

Yan Yang

Dazhong Zhang

Sumit Chawla

Berkat S Tung

Xuemei Zhang

Yingjun Bai

Roberto Garcia, Jr

Matthaeus Krenn

Douglas Scott Price

Jay Zipnick

David A Eldred

Techniques are disclosed for stabilizing a stream of spherical images captured by an image capture device to produce a stabilized spherical video sequence. The rotation of the image capture device during capture may be corrected in one or more desired axial directions in a way that is agnostic to the translation of the image capture device. The rotation of the image capture device may also be corrected in one or more desired axial directions in a way that is aware of the translation of the image capture device. For example, the assembled output spherical video sequence may be corrected to maintain the horizon of the scene at a constant location, regardless of the translation of the image capture device (i.e., a 'translation-agnostic' correction), while simultaneously being corrected to maintain the yaw of the scene in the direction of the image capture device's translation through three-dimensional space (i.e., a 'translation-aware' correction).

360 degree image presentation

Systems and methods are provided for collecting image statistics using a pixel mask. In one example, statistics collection logic of an image signal processor may include a pixel weighting mask and accumulation logic. The pixel weighting mask may receive a first representation of a pixel that includes a luma and chroma representation of the pixel. The pixel weighting mask may output a pixel weighting using first and second chroma components of the luma and chroma representation of the pixel. The accumulation logic may receive the first or a second representation of the pixel and the pixel weighting value. Using these, the accumulation logic may weight the second representation of the pixel or the first representation of the pixel using the pixel weighting value to obtain a weighted pixel value, adding the weighted pixel value to a statistics count.

Systems and methods for statistics collection using pixel mask

Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

Dual parallel processing of frames of raw image data

Some embodiments provide a method of processing images for a first camera and a second camera of a mobile device using a shared pipeline. A method receives a first set of images captured by the first camera of the mobile device. The method processes the first set of images using a first configuration of the shared pipeline. The method also receives a second set of images captured by the second camera of the mobile device, and processes the second set of images using a second configuration of the shared pipeline different from the first configuration.

Image processing for a dual camera mobile device

Systems, methods, and devices for obtaining a properly exposed strobe-illuminated image are provided. One method for doing so may include, for example, gathering image capture statistics during a first period when a strobe is not emitting light and during a second period when the strobe emits a preflash. These image capture statistics may include distinct image capture control statistics and luma values associated with the periods. Final image capture control statistics then may be determined based at least in part on the first luma value normalized to the first image capture control statistics and the second luma value normalized to the second image capture control statistics. Thereafter, the final image capture control statistics may be used to capture a properly exposed strobe-illuminated image when the strobe emits a main flash.

Systems, methods, and devices for flash exposure control using preflash statistics

Some embodiments provide a method for allowing a first device that is in a video conference with a second mobile device to remotely control the second mobile device. The method sends images captured by a camera of the first device to the second device. The method receives images captured by a camera of the second device. The method sends a command through a communication channel of a real-time communication session to the second device. The command is for instructing the second device to perform an operation that modifies the images captured by the camera of the second device.

Remote control operations in a video conference

Methods, devices and computer readable media for implementing a 'selective gray world' approach for color balancing are described. The disclosed techniques involve the use of noise-optimized selection criteria and, more specifically, in some embodiments, the interpolation between corresponding values in noise-optimized weighting tables when calculating white balance gains. Estimated scene lux levels may provide a valuable indicator of expected scene noise levels. The image processing techniques described herein may be executed by an image capture device or a general purpose processor (e.g., personal computer) executing a user-level software application. The described color balancing techniques may be implemented by dedicated or general purpose hardware, general application software, or a combination of software and hardware in a computer system.

Use of noise-optimized selection criteria to calculate scene white points

A method of manufacturing a digital video camera is provided. The method comprises acquiring video images of colored light, and measuring a light intensity response of the video camera to the colored light. The method further comprises comparing the intensity of the measured response to a desired colored light intensity for determining a color intensity bias and storing the intensity bias for the colored light in the camera so that the bias can be applied when the camera is operating at an arbitrary lighting condition.

Apparatus and method for compensating for variations in digital cameras

Dual processing of raw image data

Systems, methods, and devices for applying lens shading correction to image data captured by an image sensor are provided. In one embodiment, multiple lens shading adaptation functions, each modeled based on the response of a color channel to a reference illuminant, are provided. An image frame from the image data may be analyzed to select a lens shading adaptation function corresponding to a reference illuminant that most closely matches a current illuminant. The selected lens shading function may then be used to adjust a set of lens shading parameters.

Adaptive lens shading correction

A video image capture device includes an image sensor including an two-dimensional array of pixel elements overlaid with a pattern of color filters and having a vertical resolution different from the vertical resolutions specified for a group of video formats, a frame buffer for storing digital pixel data outputted by the image sensor, and an interpolator module for interpolating the digital pixel data to generate video data in at least three color planes and having a vertical resolution corresponding to a video format selected from the group of video formats. In one embodiment, the group of video formats includes the NTSC and PAL video formats. The vertical resolution of the image sensor has a value between the vertical resolution of the NTSC and PAL video formats. The interpolator module performs interpolation using a set of combined filters, each of the combined filters incorporating a demosaic filter and a scaling filter.

Multi-standard video image capture device using a single CMOS image sensor

A system and a method for processing image data in a digital image device such as a digital camera. The present invention includes a bus, a central processing unit coupled to the bus, an image processing subsystem coupled to the central processing unit for processing the image data using a particular processing mode, a memory unit coupled to the bus, and a data storage element for storing the image data after image processing. The memory unit has stored therein an operating system for managing the image processing subsystem, and the memory unit also has a data structure for managing the image data for the image processing subsystem during image processing. The data structure provides an interface between the operating system and the image processing subsystem, such that the operating system is independent of the processing mode used by the image processing subsystem.

Flexible architecture for image processing

Method and system aspects for reducing memory storage requirements during decompression of tiled image data are described. Included in a method aspect, and system for achieving same, are identification of a number of tiles in each row of an image, and decompression of a bitstream of compressed image data from the number of tiles in parallel to fill a band buffer with a minimum number of lines needed for processing a scan line of the image.

Growing community of inventors

San Jose, CA, United States of America

David Daming Kuo