Texas Instruments Corporation

Mayank Mangla

Shashank Dabral

Mihir Narendra Mody

Niraj Nandan

Rajasekhar Reddy Allu

Gang Hua

Brijesh Rameshbhai Jadav

Pandy Kalimuthu

Vikram Vijayanbabu Appia

Hrushikesh Tukaram Garud

Jing-Fei Ren

Sujith Shivalingappa

Hemant Hariyani

Peter Labaziewicz

Ankur Ankur

Prithvi Shankar Yeyyadi Anantha

Vikram VijayanBabu Appia

Venkat Ramana Peddigari

Gunawath Dilshan Godaliyadda

Brijesh Rameshbhal Jadav

Raja Vydhynathan

Ranjith Parakkal

A system is provided. The system generally includes a first processor configured to receive image input data from a red-green-blue infrared (RGBIR) sensor. The first processor of the system is configured to generate a first intermediate image data from the image input data. The system generally includes a second processor. The second processor of the system is configured to generate a second intermediate image data that includes red-green-blue (RGB) image data from the first intermediate image data, and to generate a third intermediate image data that includes infrared (IR) image data from the first intermediate image data. The system generally includes a third processor. The third processor of the system is configured to process the third intermediate image data. The system generally includes a fourth processor. The fourth processor of the system is configured to process the second image data.

RGBIR color filter image processing with lens shading correction

Various embodiments disclosed herein relate to defective pixel detection and correction, and more specifically to using threshold functions based on color channels to compare pixel values to threshold values. A method is provided herein that comprises identifying a color channel of an image pixel in a frame and identifying a threshold function based at least on the color channel. The method further comprises applying the threshold function to one or more nearest-neighbor values to obtain a threshold value and determining whether a corresponding sensor pixel is defective based at least on a comparison of the image pixel to the threshold value.

Defective pixel detection

In an advanced driver-assistance system (ADAS), RAW sensor image processing for a machine vision (MV) application is important. Due to different color, e.g., red/green/blue (RGB), color components, being focused by the lens at different locations in image plane, the lateral chromatic aberration phenomenon may sometimes be observed, which causes false color around edges in the final image output, especially for high contrast edges, which can impede MV applications. Disclosed herein are low-latency, efficient, optimized designs for chromatic aberration correction (CAC) components. An in-pipeline CAC design may be used to perform on-the-fly CAC without any out-of-pipeline memory traffic; enable use of wide dynamic range (WDR) sensors; uses bicubic interpolation; support vertical and horizontal chromatic aberration color channel offsets, reduce CAC line memory requirements, and support flexible look-up table (LUT) down-sampling factors to improve the spatial precision of correction and accommodate popular image sensor resolutions.

In-line chromatic aberration correction in wide dynamic range (WDR) image processing pipeline

A technique including receiving an image stream for processing; processing the received image stream in a real time mode of operation; outputting an indication that an image processing pipeline has begun processing the received image stream; receiving, in response to the indication, first configuration information associated with test data for testing the image processing pipeline; switching the image processing pipeline to a non-real time mode of operation to process the test data based on the first configuration information during a vertical blanking period of the received image stream; loading the test data from an external memory; switching an input of the image processing pipeline from the image stream to the test data; determining a checksum based on the processed test data; comparing the determined checksum to an expected checksum to determine that the test data was successfully processed; and outputting an indication that the test data was successfully processed.

Fault detection in a real-time image pipeline

A technique for determining regions and block sizes for configuring a perspective transformation engine including determining a set of scale ratios for images captured by a camera, generating a scale ratio image based on the set of scale ratios, determining a set of boundary ranges for the scale ratio image, generating a binary scale ratio image using the set of scale ratios of the scale ratio image, determining a set of regions based on the set of boundary ranges for the binary scale ratio image, determining a block size for each region of the determined set of regions, and outputting the determined set of regions and the determined block sizes.

Dynamic configuration of perspective transformation engine

A method for automatic exposure (AE) control is provided that includes receiving statistics for AE control for an image from an image signal processor (ISP) coupled to an image sensor generating the image, computing an exposure value at a current time t (EV(t)) using a cost function based on target characteristics of an image, wherein computation of the cost function uses the statistics, and computing AE settings for the image sensor based on EV(t).

Method and apparatus for automatic exposure

A method of WDR imaging. Exposure times (ETs) are set for first and second frames for an image sensor to avoid second frame saturating by setting a second ET&#x3e;1/a PWM frequency applied to an LED illuminating a scene to generate second longer ET pixel data (PD). The first frame has first PD and a first ET&#x3c;the second ET. A high and low intensity threshold are calculated from a full well capacity. Raw image signals are obtained originating from the image sensor of the scene. Flicker is detected by comparing the first and second frame intensity values to the high and low threshold to determine whether the first PD is flickering data. A WDR merge is performed by selecting weightings from the first and second PD for each pixel including increasing weighting of the second PD for flicker. A final image is formed from the weighted WDR merge.

WDR imaging with LED flicker mitigation

In the advanced driver-assistance systems (ADAS) field, RAW sensor image processing for machine vision (MV) applications can be of critical importance. Due to red/green/blue (RGB) image components being focused by the lens at different locations in image plane, the lateral chromatic aberration (LCA) phenomenon may sometimes be observed, which causes false color around edges in the final image output, especially for high contrast edges, which can impede MV applications. Disclosed herein are low-latency, efficient, optimized designs for chromatic aberration correction (CAC) modules. In some embodiments, an in-pipeline CAC design is used that: is configured to perform on-the-fly CAC without any out-of-pipeline memory traffic; enables use of wide dynamic range (WDR) sensors; uses bicubic interpolation; supports vertical and horizontal chromatic aberration red/blue color channel offsets, reduces CAC line memory requirements, and supports flexible look-up table (LUT) down-sampling factors to improve the spatial precision of correction and accommodate popular image sensor resolutions.

A system on a chip (SoC) implementing dynamic grouping of multiple cameras in an image processing system is disclosed. The SoC includes an image signal processor (ISP) configured to receive a signal corresponding to an image from two or more cameras, dynamically group the cameras into groups based on a measured view brightness and/or color temperature observed by each of the cameras, and assign cameras with a group of the groups to a same exposure/gain setting. The SoC further includes a statistics engine configured to receive the image signals and statistics related to the image signals from the ISP and determine a measurement of image brightness and/or color temperature of each image based on the image signals for forwarding to the ISP.

Multi camera image processing

Digital mirror systems for vehicles and methods of operating the same are disclosed. An example vehicle control system includes: a driver monitoring system including a head position determiner to determine at least one of a location of a head, an orientation of the head, or an eye gaze point of the head; a digital mirror system including a region-of-interest (ROI) detector to identify an ROI based on the at least one of the location of the head, the orientation of the head, or the eye gaze point of the head, and a cropper to extract a portion of a first image corresponding to the ROI to form a second image, the first image representing an area exterior to the vehicle; and a display within an interior area of the vehicle to present the second image.

Digital mirror systems for vehicles and methods of operating the same

A method for displaying a surround view on a single display screen is disclosed. A plurality of image frames for a particular time may be received from a corresponding plurality of cameras. A viewpoint warp map corresponding to a predetermined first virtual viewpoint may be selected, wherein the viewpoint warp map defines a source pixel location in the plurality of image frames for each output pixel location in the display screen. The warp map was predetermined offline and stored for later use. An output image is synthesized for the display screen by selecting pixel data for each pixel of the output image from the plurality of image frames in accordance with the viewpoint warp map. The synthesized image is then displayed on a display screen.

Growing community of inventors

Allen, TX, United States of America

Mayank Mangla