Nvidia Corporation

Argo Ai Gmbh

Volkswagen Group of America Investments, LLC

Dikpal Reddy

Hsin Miao

Douglas Robert Lanman

Jan Kautz

David Patrick Luebke

Kari Pulli

Felix Heide

Richard L Kwant

Hatem Alismail

Koji Gardiner

Duc H Vu

Yu-Wei Chang

Cole Hartman

Erli Ding

Willibald Brems

Methods and systems for determining whether a camera of an autonomous vehicle (AV) is calibrated are disclosed. The method includes using image frames captured by a camera of the AV and LIDAR point clouds captured by a LIDAR system of the AV to calculate an AV pose calibration metric. The method also includes: measuring a distance metric between a three-dimensional bounding box around an object and a two-dimensional bounding box in an image captured by the camera; using the AV pose calibration metric and the distance calibration metric to generate a confidence score; and in response to the confidence score being below a threshold, generating a signal indicating that the camera is not calibrated.

Systems and methods for validating camera calibration in real-time

Systems and methods for generating operating an autonomous vehicle. The methods comprise: obtaining LiDAR point cloud data generated by a LiDAR system of the autonomous vehicle; inspecting the LiDAR point cloud data to infer a health of LiDAR beams; identifying bad quality point cloud data based on the inferred health of the LiDAR beams; removing the bad quality point cloud data from the LiDAR point cloud data to generate modified LiDAR point cloud data; and causing the autonomous vehicle to perform at least one autonomous driving operation or mode change based on the modified LiDAR point cloud data.

Systems and methods for monitoring LiDAR sensor health

A method for calibration of vision sensors includes, by a processor: selecting a calibration sequence that has a base calibration pattern and calibration angles, generating a calibrating target that may include the calibration pattern at a selected calibration angle of the angles, and causing a display screen to display a digital image representative of the target at the selected angle relative to an originating border of the selected angle. Each of the calibration angles is associated with a different originating border of the screen. The method includes by a vision sensor capturing at least one image of the calibrating target displayed on the screen. The calibration is repeated for each calibration angle of the sequence. The method includes performing calibration of the vision sensor in response to image signal processing of extracted calibration features in the at least one image of the calibrating targets.

Method and system to calibrate camera devices of a vehicle vision system using a programmable calibration target device

An apparatus and method for joint calibration of vision and radar sensors for an autonomous device is disclosed. The apparatus may include a spherical portion and a cutout portion. The cutout portion may be formed within the spherical portion and have three equal surfaces. Additionally, the apparatus may include a trihedral reflector positioned within the cutout portion.

Apparatus for joint calibration of radar and camera systems for autonomous vehicle applications

System and method of displaying images in temporal superresolution by multiplicative superposition of cascaded display layers integrated in a display device. Using an original video with a target temporal resolution as a priori, a factorization process is performed to derive respective image data for presentation on each display layer. The multiple layers are refreshed in staggered intervals to synthesize a video with an effective refresh rate exceeding that of each individual display layer, e.g., by a factor equal to the number of layers. Further optically averaging neighboring pixels can minimize artifacts.

Superresolution display using cascaded panels

System and method of displaying images in spatial/temporal superresolution by multiplicative superposition of cascaded display layers integrated in a display device. Using an original image with a target spatial/temporal resolution as a priori, a factorization process is performed to derive respective image data for presentation on each display layer. The cascaded display layers may be progressive and laterally shifted with each other, resulting in an effective spatial resolution exceeding the native display resolutions of the display layers. Factorized images may be refreshed on respective display layers in synchronization or out of synchronization.

Growing community of inventors

Palo Alto, CA, United States of America

Dikpal Reddy