Nvidia Corporation

Qualcomm Incorporated

Rotem Aviv

David Nister

Urs A Muller

Nikolai Smolyanskiy

Julia C Ng

Bernhard Firner

Alexey Kamenev

Yizhou Wang

Birgit Henke

Zongyi Yang

Hon Leung Lee

Ollin Boer Bohan

Fangkai Yang

Jesse Hong

Joyjit Daw

Roberto Giuseppe Luca Valenti

Ruchi Bhargava

Joshua John Bialkowski

Ishwar Kulkarni

Miguel Sainz Serra

Zhenyi Zhang

Raul Correal Tezanos

Yunfei Shi

Anton Vorontsov

Seungho Lee

Alperen Degirmenci

Hermes Lanker

In various examples, sensor data recorded in the real-world may be leveraged to generate transformed, additional, sensor data to test one or more functions of a vehicle—such as a function of an AEB, CMW, LDW, ALC, or ACC system. Sensor data recorded by the sensors may be augmented, transformed, or otherwise updated to represent sensor data corresponding to state information defined by a simulation test profile for testing the vehicle function(s). Once a set of test data has been generated, the test data may be processed by a system of the vehicle to determine the efficacy of the system with respect to any number of test criteria. As a result, a test set including additional or alternative instances of sensor data may be generated from real-world recorded sensor data to test a vehicle in a variety of test scenarios.

Simulating realistic test data from transformed real-world sensor data for autonomous machine

In various examples, past location information corresponding to actors in an environment and map information may be applied to a deep neural network (DNN)—such as a recurrent neural network (RNN)—trained to compute information corresponding to future trajectories of the actors. The output of the DNN may include, for each future time slice the DNN is trained to predict, a confidence map representing a confidence for each pixel that an actor is present and a vector field representing locations of actors in confidence maps for prior time slices. The vector fields may thus be used to track an object through confidence maps for each future time slice to generate a predicted future trajectory for each actor. The predicted future trajectories, in addition to tracked past trajectories, may be used to generate full trajectories for the actors that may aid an ego-vehicle in navigating the environment.

Future trajectory predictions in multi-actor environments for autonomous machine

Embodiments of the present disclosure relate to behavior planning for autonomous vehicles. The technology described herein selects a preferred trajectory for an autonomous vehicle based on an evaluation of multiple hypothetical trajectories by different components within a planning system. The various components provide an optimization score for each trajectory according to the priorities of the component and scores from multiple components may form a final optimization score. This scoring system allows the competing priorities (e.g., comfort, minimal travel time, fuel economy) of different components to be considered together. In examples, the trajectory with the best combined score may be selected for implementation. As such, an iterative approach that evaluates various factors may be used to identify an optimal or preferred trajectory for an autonomous vehicle when navigating an environment.

Behavior planning for autonomous vehicles

In various examples, a yield scenario may be identified for a first vehicle. A wait element is received that encodes a first path for the first vehicle to traverse a yield area and a second path for a second vehicle to traverse the yield area. The first path is employed to determine a first trajectory in the yield area for the first vehicle based at least on a first location of the first vehicle at a time and the second path is employed to determine a second trajectory in the yield area for the second vehicle based at least on a second location of the second vehicle at the time. To operate the first vehicle in accordance with a wait state, it may be determined whether there is a conflict between the first trajectory and the second trajectory, where the wait state defines a yielding behavior for the first vehicle.

Behavior planning for autonomous vehicles in yield scenarios

In various examples, sensor data recorded in the real-world may be leveraged to generate transformed, additional, sensor data to test one or more functions of a vehicle—such as a function of an AEB, CMW, LDW, ALC, or ACC system. Sensor data recorded by the sensors may be augmented, transformed, or otherwise updated to represent sensor data corresponding to state information defined by a simulation test profile for testing the vehicle function(s). Once a set of test data has been generated, the test data may be processed by a system of the vehicle to determine the efficacy of the system with respect to any number of test criteria. As a result, a test set including additional or alternative instances of sensor data may be generated from real-world recorded sensor data to test a vehicle in a variety of test scenarios—including those that may be too dangerous to test in the real-world.

Simulating realistic test data from transformed real-world sensor data for autonomous machine applications

In a particular embodiment, a method includes receiving line segment data at a processing core. The line segment data is associated with multiple candidate line segments associated with a first group of pixels of an image. The line segment data includes an angle value and/or a distance value for each of the multiple candidate line segments. The method further includes identifying, at the processing core, a set of line segments of the multiple candidate line segments by comparing angle values and/or distance values associated with the multiple candidate line segments. The method also includes determining, at the processing core, a representative line segment based on the set of line segments of the multiple candidate line segments. The method further includes storing, by the processing core, line segment information based on the representative line segment.

Systems and methods for processing image data associated with line detection

Growing community of inventors

San Diego, CA, United States of America

Rotem Aviv