Uatc, LLC

Fang-Chieh Chou

Nemanja Djuric

Henggang Cui

Jeff Schneider

Tsung-Han Lin

Thi Duong Nguyen

Vladan Radosavljevic

Tzu-Kuo Huang

Sai Bhargav Yalamanchi

Junheng Wang

Mohana Prasad Sathya Moorthy

David McAllister Bradley

Carlos Vallespi-Gonzalez

Brian C Becker

Abhishek Mohta

Systems and methods are disclosed for detecting and predicting the motion of objects within the surrounding environment of a system such as an autonomous vehicle. For example, an autonomous vehicle can obtain sensor data from a plurality of sensors comprising at least two different sensor modalities (e.g., RADAR, LIDAR, camera) and fused together to create a fused sensor sample. The fused sensor sample can then be provided as input to a machine learning model (e.g., a machine learning model for object detection and/or motion prediction). The machine learning model can have been trained by independently applying sensor dropout to the at least two different sensor modalities. Outputs received from the machine learning model in response to receipt of the fused sensor samples are characterized by improved generalization performance over multiple sensor modalities, thus yielding improved performance in detecting objects and predicting their future locations, as well as improved navigation performance.

Systems and methods for sensor data processing and object detection and motion prediction for robotic platforms

Systems and methods for predicting object motion and controlling autonomous vehicles are provided. In one example embodiment, a computer implemented method includes obtaining state data indicative of at least a current or a past state of an object that is within a surrounding environment of an autonomous vehicle. The method includes obtaining data associated with a geographic area in which the object is located. The method includes generating a combined data set associated with the object based at least in part on a fusion of the state data and the data associated with the geographic area in which the object is located. The method includes obtaining data indicative of a machine-learned model. The method includes inputting the combined data set into the machine-learned model. The method includes receiving an output from the machine-learned model. The output can be indicative of a plurality of predicted trajectories of the object.

Object motion prediction and autonomous vehicle control

Systems and methods for training machine-learned models are provided. A method can include receiving a rasterized image associated with a training object and generating a predicted trajectory of the training object by inputting the rasterized image into a first machine-learned model. The method can include converting the predicted trajectory into a rasterized trajectory that spatially corresponds to the rasterized image. The method can include utilizing a second machine-learned model to determine an accuracy of the predicted trajectory based on the rasterized trajectory. The method can include determining an overall loss for the first machine-learned model based on the accuracy of the predictive trajectory as determined by the second machine-learned model. The method can include training the first machine-learned model by minimizing the overall loss for the first machine-learned model.

Systems and methods for training predictive models for autonomous devices

Systems, methods, tangible non-transitory computer-readable media, and devices associated with the motion prediction and operation of a device including a vehicle are provided. For example, a vehicle computing system can access state data including information associated with locations and characteristics of objects over a plurality of time intervals. Trajectories of the objects at subsequent time intervals following the plurality of time intervals can be determined based on the state data and a machine-learned tracking and kinematics model. The trajectories of the objects can include predicted locations of the objects at subsequent time intervals that follow the plurality of time intervals. Further, the predicted locations of the objects can be based on physical constraints of the objects. Furthermore, indications, which can include visual indications, can be generated based on the predicted locations of the objects at the subsequent time intervals.

Motion prediction for autonomous devices

Growing community of inventors

San Francisco, CA, United States of America

Fang-Chieh Chou