Waymo LLC

Yulai Shen

Jeffrey Sham

Jeffrey Carlson

Dragomir Dimitrov Anguelov

Lo Po Tsui

Henrik Kretzschmar

Maya Kabkab

Congyu Gao

Sandro Alighiero Young

Sakshi Madan

Gen Liu

Homero Menchaca Hernández

Ningshan Zhang

Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for generating label data for one or more target objects in an environment. The system obtains first data characterizing the environment, wherein the first data includes position data characterizing a position of the target object. The system obtains second data including one or more three-dimensional (3D) frames characterizing the environment. The system determines, based on the first data, a guide feature for locating the target object in the 3D frames of the second data. The system receives a first user input that specifies at least an object position in the selected 3D frame, and generates label data for the target object based on the first user input.

Object labeling for three-dimensional data

Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for generating and editing object track labels for objects detected in video data. One of the methods includes obtaining a video segment comprising multiple image frames associated with multiple time points; obtaining object track data specifying a set of object tracks; providing, for presentation to a user, a user interface for modifying the object track data, the user interface displaying object timeline representations of the object tracks; receiving one or more user inputs that indicate one or more modifications to the object timeline representations; updating the object timeline representations displayed in the timeline display area; and updating the object track data according to the updated object timeline representations.

Time-line based object tracking annotation

Methods and systems for associating labels between multiple sensors. One of the methods includes generating user interface presentation data that, when presented on a user device, causes the user device to display a user interface that: displays the images in the sequence of images and data identifying the first and second object tracks, and is configured to receive user inputs that associate first object tracks with second object tracks; and providing the user interface presentation data for presentation on the user device.

Associating labels between multiple sensors

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium that generates lane path descriptors for use by autonomous vehicles. One of the methods includes receiving data that defines valid lane paths in a scene in an environment. Each valid lane path represents a path through the scene that can be traversed by a vehicle. User interface presentation data can be provided to a user device. The user interface can contain: (i) a first display area that displays a first visual representation of the sensor measurement; and (ii) a second display area that displays a second visual representation of the set of valid lane paths. User input modifying the second visual representation of the set of valid lane paths can be received; and in response to receiving the user input, the set of valid lane paths of the scene in the environment can be modified.

Lane path modification framework

Growing community of inventors

Sunnyvale, CA, United States of America

Yulai Shen