Zoox, Inc.

Xiaosi Zeng

Marin Kobilarov

Kai Zhenyu Wang

Ethan Miller Pronovost

Gowtham Garimella

Andres Guillermo Morales Morales

Prateek Chandresh Shah

Deepan Subrahmanian Palguna

Robert Jonathan Crane

Wentao Zhong

John Connelly Kegelman

Techniques for determining unified futures of objects in an environment are discussed herein. Techniques may include determining a first feature associated with an object in an environment and a second feature associated with the environment and based on a position of the object in the environment, updating a graph neural network (GNN) to encode the first feature and second feature into a graph node representing the object and encode relative positions of additional objects in the environment into one or more edges attached to the node. The GNN may be decoded to determine a distribution of predicted positions for the object in the future that meet a criterion, allowing for more efficient sampling. A predicted position of the object in the future may be determined by sampling from the distribution.

Focusing prediction distribution output for efficient sampling

Techniques for determining unified futures of objects in an environment are discussed herein. Techniques may include determining a first feature associated with an object in an environment and a second feature associated with the environment and based on a position of the object in the environment, updating a graph neural network (GNN) to encode the first feature and second feature into a graph node representing the object and encode relative positions of additional objects in the environment into one or more edges attached to the node. The GNN may be decoded to determine a distribution of predicted positions for the object in the future. A predicted position of the object at a subsequent timestep may be determined by sampling from the distribution of predicted positions according to various sampling strategies. Alternatively, the predicted position of the object may be overwritten using a candidate position of the object.

Prediction sampling techniques

Techniques for determining unified futures of objects in an environment are discussed herein. Techniques may include determining a first feature associated with an object in an environment and a second feature associated with the environment and based on a position of the object in the environment, updating a graph neural network (GNN) to encode the first feature and second feature into a graph node representing the object and encode relative positions of additional objects in the environment into one or more edges attached to the node. The GNN may be decoded to determine a predicted position of the object at a subsequent timestep. Further, a predicted trajectory of the object may be determined using predicted positions of the object at various timesteps.

Encoding relative object information into node edge features

Techniques for generating simulations to evaluate an update to a controller. The controller may be configured to control one or more functionalities of an autonomous and/or a semi-autonomous vehicle. A simulation computing system may receive a request to evaluate a first controller. The simulation computing system may generate a simulation based on data associated with a previous operation of the vehicle in an environment, the previous operation being controlled by a second controller (e.g., standard for evaluation, control version, etc.). The simulation computing device may cause the first controller to control a simulated vehicle in the simulation and may determine whether to validate the update to the controller based on a difference between first metrics associated with a control of the simulated vehicle by the first controller and second metrics associated with a control of the vehicle by the second controller.

Vehicle controller validation

Growing community of inventors

San Mateo, CA, United States of America

Xiaosi Zeng