Nxp USA, Inc.

Nxp B.v.

Sharath Subramanya Naidu

Michael Andreas Staudenmaier

Ajit Singh

Stephan Matthias Herrmann

Leonardo Surico

Ankur Bindal

Chanpreet Singh

Rahul Jain

Nikhil Sharma

Juhee Mala

Maninder Kumar

Bhagwan Babu Jha

A system, method, and apparatus are provided for on-the-fly camera image processing configuring a system-on-chip (SoC) configuration register memory with one or more synchronization settings; processing multiple camera image frame sequences having different specified exposures to detect a set of complete frames from the camera image frame sequences which have a first common frame number; identifying a valid combination of different exposures from the image frame sequences having a second common frame number succeeding the first common frame number; and processing the valid combination of different exposures from the first and second camera image frame sequences to generate output data from the ISP pipeline.

Real time stream camera ISP with loosely coupled control loop

A camera system and method are disclosed. The camera includes a memory, a camera, and a processor. The memory stores an adaptively subsampled look-up table. The adaptively subsampled look-up includes varying levels of subsampling across the adaptively subsampled look-up table. The camera captures an image, and the captured image is distorted based on varying distortions within an optical system of the camera. The processor receives the captured image from the camera, corrects the distorted captured image based on the adaptively subsampled look-up table to create a correct image, provides the corrected image, and executes a safety feature based on the corrected image.

System and method for adaptive correction factor subsampling for geometric correction in an image processing system

An image processing circuit for correcting a distorted image includes an internal memory and a correction circuit. The internal memory of the image processing circuit is configured to store a radial look-up table (LUT), a set of tangential LUTs, and co-ordinates of a correction center of the distorted image. The radial LUT and the set of tangential LUTs include first and second sets of parameters to correct radial and tangential distortion of the distorted image, respectively. The correction circuit is configured to reconstruct portions of the correction LUT on-the-fly based on the radial LUT, the set of tangential LUTs, and the co-ordinates of the correction center, and correct portions of the distorted image based on the reconstructed portions of correction LUT to generate the portions of the corrected image.

System and method for correcting geometric distortion in images

A system and method for correcting image distortion is provided. The system and method remaps pixel position of distorted images using a combination of radial distortion correction and tangential distortion correction lookup tables consuming less physical memory. The solution conserves both memory and memory access bandwidth. The radial distortion correction lookup table is formed by taking advantage of radial distortion being generally symmetric about a determined optical center of the camera lens. This symmetry allows for use of a quarter LUT for correction in all quadrants of a distorted image. In addition, tangential distortion can be corrected in a symmetric manner that saves memory space as well.

Method and system for image distortion correction using quarter and tangential lookup tables

Embodiments provide line-based feature generation for vision-based driver assistance systems and methods. For one embodiment, a feature generator includes a circular buffer and a processor coupled to an image sensor. The circular buffer receives image data from the image sensor and stores N lines at a time of an image frame captured by the image sensor. The N lines of the image frame are less than all of the lines for the image frame. The processor receives the N lines from the circular buffer and stores one or more features generated from the N lines in a memory. Iterative blocks of N lines of image data are processed to complete processing of the full image frame, and multiple frames can be processed. The generated features are analyzed by a vision processor to identify, classify, and track objects for vision-based driver assistance and related vision-based assistance actions.

Line-based feature generation for vision-based driver assistance systems and methods

A geometric correction system and method for performing geometric correction of a distorted image in an input frame to provide a corrected image in an output frame including a local memory, geometric correction circuitry, a tile reader, and a descriptor memory storing multiple tile descriptors. The tile reader retrieves distorted tile data from the input frame into the local memory for one corrected tile group at a time according to a corresponding tile descriptor. Each tile descriptor identifies distorted tile data to retrieve and distorted tile data to skip from the local memory for the corresponding corrected tile group. The tile descriptor includes a descriptor for each row of local memory area identifying data to be read and data to be skipped for each row. Only the data needed for one or more target tiles is read to reduce memory transfer bandwidth overhead.

System and method of using optimized descriptor coding for geometric correction to reduce memory transfer bandwidth overhead

Embodiments are disclosed that apply adaptive sub-tiles to captured images for distortion correction in vision-based assistance systems and methods. A captured image is processed to generate corrected tiles, and selected numbers of sub-tiles are used to generate each of the corrected tiles depending upon the pixel densities for regions of the captured image. The corrected sub-tiles are combined to form corrected tiles, and corrected tiles are combined for form a corrected image. The corrected image can be used to output control signals to cause actions to be issued to a user of the system such as a driver of a vehicle. For one embodiment, the corrected tiles are generated one at a time, and corrected sub-tiles for each corrected tile are also generated one at a time based upon individual source data blocks determined by a pre-determined sub-tile configuration. Efficient memory use and data transfers are provided.

Growing community of inventors

Munich, Germany

Sharath Subramanya Naidu