Object detection using sensor fusion for autonomous systems and applications

Abstract

In various examples, sensor fusion for autonomous or semi-autonomous systems and applications is described. Systems and methods are disclosed that use data pipelines to process sensor data generated using different types of sensors (e.g., image sensors, RADAR sensors, LiDAR sensors, etc.) in order to generate first data representing information associated with objects surrounding a vehicle. For instance, the information may represent values for parameters associated with the objects, such as locations of the objects, dimensions of the objects, velocities of the objects, orientations of the objects, classifications of the objects, and/or any of parameters. The systems and methods may then process the first data using one or more machine learning models (e.g., one or more deep neural networks) that are trained to fuse the information (e.g., the parameters) and output second data representing final information associated with the objects. The fused output may then be used to perform downstream operations.