Apple Inc.

Jay Zipnick

Brett C Bilbrey

Alexei V Ouzilevski

Fernando A Urbina

Haitao Guo

Ting Chen

Harry Guo

Sumit Chawla

Farhan A Baqai

David Daming Kuo

Andrew Yanowitz

Samuel A Figueroa

Systems and techniques for processing sequences of video images involve receiving, on a computer, data corresponding to a sequence of video images detected by an image sensor. The received data is processed using a graphics processor to adjust one or more visual characteristics of the video images corresponding to the received data. The received data can include video data defining pixel values and ancillary data relating to settings on the image sensor. The video data can be processed in accordance with ancillary data to adjust the visual characteristics, which can include filtering the images, blending images, and/or other processing operations.

Video acquisition with processing based on ancillary data

A system that adjusts chroma and luma values for a video signal is presented. During operation, the system receives a matrix of coefficients, which when applied to the chroma values and the luma values of a video signal produces substantially the same result as performing a sequence of discrete operations on the chroma values and the luma values, wherein the sequence of discrete operations includes one or more color-representation-conversion operations and one or more processing amplifier operations. For a given pixel of the video signal, the system performs a matrix-multiplication operation between a matrix representation of the chroma values and the luma values for the given pixel and the matrix of coefficients to produce a modified pixel.

Method and apparatus for adjusting chroma and luma for a video signal

A video enhancement processing system improves perceptual quality of video data with limited processing complexity. The system may perform spatial denoising using filter weights that may vary based on estimated noise of an input image. Specifically, estimated noise of the input image may alter a search neighborhood over which the denoising filter operates, may alter a profile of weights to be applied based on pixel distances and may alter a profile of weights to be applied based on similarity of pixels for denoising processes. As such, the system finds application in consumer devices that perform such enhancement techniques in real time using general purpose processors such as CPUs or GPUs.

Real time denoising of video

Video acquisition with integrated GPU processing

A technique for applying black level compensation to image data is provided. In one embodiment, an image processing system includes a first image processing pipeline configured to receive frames of image data generated by an image sensor and to alter the frames of image data to compensate for black level shift. The image processing system may also include a feed-forward loop having a second image processing pipeline configured to receive at least one of the frames of image data, to process the at least one frame, and to adjust a black level compensation parameter of the first image processing pipeline. Additional methods, systems, and devices relating to black level compensation are also disclosed.

Compensation for black level changes

Systems, methods, and devices for applying lens shading correction to image data captured by an image sensor are provided. In one embodiment, multiple lens shading adaptation functions, each modeled based on the response of a color channel to a reference illuminant, are provided. An image frame from the image data may be analyzed to select a lens shading adaptation function corresponding to a reference illuminant that most closely matches a current illuminant. The selected lens shading function may then be used to adjust a set of lens shading parameters.

Adaptive lens shading correction

A computer-implemented method is for controlling display of an image, in a display area, by a display device. A plurality of elements of a sequence is determined based on operation of an input device. A position in the entire image is determined, associated with the determined one of the plurality of elements in the sequence. Based on the determined position in the entire image, a corresponding portion of the entire image is caused to be displayed in the display area.

Growing community of inventors

Morgan Hill, CA, United States of America

Jay Zipnick