Zoox, Inc.

Allan Zelener

Stanley L Volta

Zeng Wang

David Pfeiffer

Dragomir Dimitrov Anguelov

Subhasis Das

Francesco Papi

Qian Song

Qiang Zhai

Arthur Daniel Costea

Techniques for segmenting sensor data are discussed herein. Data can be represented in individual levels in a multi-resolution voxel space. A first level can correspond to a first region of an environment and a second level can correspond to a second region of an environment that is a subset of the first region. In some examples, the levels can comprise a same number of voxels, such that the first level covers a large, low-resolution region, while the second level covers a smaller, higher-resolution region, though more levels are contemplated. Operations may include analyzing sensor data represented in the voxel space from a perspective, such as a top-down perspective. From this perspective, techniques may generate masks that represent objects in the voxel space. Additionally, techniques may generate segmentation data to verify and/or generate the masks, or otherwise cluster the sensor data.

Multi-resolution top-down segmentation

Techniques for detecting and classifying objects using lidar data are discussed herein. In some cases, the system may be configured to utilize a predetermined number of prior frames of lidar data to assist with detecting and classifying objects. In some implementations, the system may utilize a subset of the data associated with the prior lidar frames together with the full set of data associated with a current frame to detect and classify the objects.

Method for predicting behavior of object e as an autonomous vehicles, determining afggregated data based on first and second lidars data and transfer function

A method is provided comprising performing a first sweeping scan using a sensor (e.g. a lidar sensor) of a vehicle when the vehicle is navigating in a first direction. The first sweeping scan comprises a seam at a first location relative to the vehicle. A second sweeping scan is defined when the vehicle is navigating in a second direction. The second sweeping scan comprises a seam at a different second location relative to the vehicle. The vehicle is controlled based at least in part on the first sweeping scan.

Processing sensor data

Techniques for determining detection boxes representing objects in an environment using pixel clustering are disclosed herein. Autonomous vehicle sensors can capture data in an environment that may include separate objects, such as large and/or articulated vehicles. In an example, the data can include a plurality of pixels that are associated with a large object. A vehicle computing system can generate a detection box for each pixel of the plurality of pixels and can determine at least one averaged detection box representing the large object. In an example, the vehicle computing system can control the vehicle based in part on the at least one averaged detection boxes.

Detection clustering

A computer implemented method. Includes: obtaining, from a sensor system onboard a vehicle, a plurality of hypotheses for an orientation of an object in a vicinity of the vehicle, relative to a coordinate system of the vehicle; estimating, based on the plurality of hypotheses, values of a probability distribution for the orientation of the object at a plurality of candidate orientations; and estimating, based at least in part on the estimated values of the probability distribution at the plurality of candidate orientations, the orientation of the object relative to the coordinate system.

Object orientation estimator

Detection box determination based on pixel clustering

A vehicle can include various sensors to detect objects in an environment. Sensor data can be captured by a perception system in a vehicle and represented in a voxel space. Operations may include analyzing the data from a top-down perspective. From this perspective, techniques can associate and generate masks that represent objects in the voxel space. Through manipulation of the regions of the masks, the sensor data and/or voxels associated with the masks can be clustered or otherwise grouped to segment data associated with the objects.

Growing community of inventors

San Mateo, CA, United States of America

Allan Zelener