Nvidia Corporation

Yu Sheng

David Nister

Amir Akbarzadeh

Birgit Henke

Ivana Stojanovic

Michael Kroepfl

Enliang Zheng

Andrew Carley

Si Lu

Jugnu Agrawal

Ruchi Bhargava

Neda Cvijetic

Ibrahim Eden

Vaibhav Thukral

Michael Grabner

Youding Zhu

Jeffrey Liu

Vadim Cugunovs

Niharika Arora

Jordan Marr

Embodiments of the present disclosure relate to generating RADAR (RAdio Detection And Ranging) point clouds based on RADAR data obtained from one or more RADAR sensors disposed on one or more ego-machines. In these or other embodiments, the RADAR point clouds may be used to generate map data. Additionally or alternatively, the RADAR point clouds may be used for performing localization.

Sensor data point cloud generation for map creation and localization for autonomous systems and applications

One or more embodiments of the present disclosure relate to generation of map data. In these or other embodiments, the generation of the map data may include determining whether objects indicated by the sensor data are static objects or dynamic objects. Additionally or alternatively, sensor data may be removed or included in the map data based on determinations as to whether it corresponds to static objects or dynamic objects.

Sensor data based map creation for autonomous systems and applications

One or more embodiments of the present disclosure relate to generating RADAR (RAdio Detection And Ranging) point clouds based on RADAR data obtained from one or more RADAR sensors disposed on one or more ego-machines. In these or other embodiments, the RADAR point clouds may be communicated to a distributed map system that is configured to generate map data based on the RADAR point clouds. In some embodiments of the present disclosure, certain compression operations may be performed on the RADAR point clouds to reduce the amount of data that is communicated from the ego-machines to the map system.

Sensor data based map creation and localization for autonomous systems and applications

An end-to-end system for data generation, map creation using the generated data, and localization to the created map is disclosed. Mapstreams&#x2014;or streams of sensor data, perception outputs from deep neural networks (DNNs), and/or relative trajectory data&#x2014;corresponding to any number of drives by any number of vehicles may be generated and uploaded to the cloud. The mapstreams may be used to generate map data&#x2014;and ultimately a fused high definition (HD) map&#x2014;that represents data generated over a plurality of drives. When localizing to the fused HD map, individual localization results may be generated based on comparisons of real-time data from a sensor modality to map data corresponding to the same sensor modality. This process may be repeated for any number of sensor modalities and the results may be fused together to determine a final fused localization result.

Map creation and localization for autonomous driving applications

Growing community of inventors

San Diego, CA, United States of America

Yu Sheng