Waymo LLC

Google Inc.

Benjamin James Caine

Vijay Vasudevan

Jiquan Ngiam

Zhifeng Chen

Jonathon Shlens

Ouais Alsharif

Wei Han

Brandon Chauloon Yang

Chen Wu

Junhua Mao

Pei Sun

Yuning Chai

Christoph Sprunk

Zhengdong Zhang

Dragomir Dimitrov Anguelov

Khaled Refaat

Xiao Meng Zhang

Patrick An Phu Nguyen

Wei Chai

Yin Zhou

Benjamin Sapp

Weiyue Wang

Liting Sun

Scott Morgan Ettinger

Xi Yi

Rebecca Dawn Roelofs

Methods, systems, and apparatus for predicting future trajectories of agents in an environment. In one aspect, a system comprises one or more computers configured to receive a data set comprising multiple training examples. The training examples include scene data comprising respective agent data for multiple agents and a ground truth trajectory for a target agent that represents ground truth motion of the target agent after a corresponding time point. The one or more computers obtain data identifying one or more of the multiple agents as non-causal agents for each training example. A non-causal agent is an agent whose states do not cause the ground truth trajectory for the target agent to change. The one or more computers generate a respective modified training example from each of the multiple training examples.

Robust behavior prediction neural networks through non-causal agent based augmentation

Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for processing a perspective view range image generated from sensor measurements of an environment. The perspective view range image includes a plurality of pixels arranged in a two-dimensional grid and including, for each pixel, (i) features of one or more sensor measurements at a location in the environment corresponding to the pixel and (ii) geometry information comprising range features characterizing a range of the location in the environment corresponding to the pixel relative to the one or more sensors. The system processes the perspective view range image using a first neural network to generate an output feature representation. The first neural network comprises a first perspective point-set aggregation layer comprising a geometry-dependent kernel.

Processing perspective view range images using neural networks

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing data generated by a sensing system that rotationally senses an environment. In one aspect, a method comprises partitioning a predetermined period of time into a plurality of sub-periods, wherein the predetermined period of time is a period of time for which data generated by the sensing system constitutes a complete rotational sensing of the environment; for each sub-period: receiving current data generated by the sensing system during the sub-period and characterizing a respective partial scene of the environment; processing the current data using an object detection neural network to generate a current object detection output that is specific to the respective partial scene of the environment.

Streaming object detection within sensor data

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data representing a sensor measurement of a scene captured by one or more sensors to generate an object detection output that identifies locations of one or more objects in the scene. When deployed within an on-board system of a vehicle, the object detection output that is generated can be used to make autonomous driving decisions for the vehicle with enhanced accuracy.

Object detection in point clouds

Growing community of inventors

San Francisco, CA, United States of America

Benjamin James Caine