Lyft, Inc.

Ouster, Inc.

Mushfiqur Rouf

Henru Wang

Lei Zhang

Ashesh Jain

Yunjian Jiang

Angus Pacala

Daniel Lu

Kairen Wong

Dmitri Garbuzov

Wil Selby

Examples disclosed herein may involve a computing system that is configured to (i) obtain previously-derived perception data for a collection of sensor data including a sequence of frames observed by a vehicle within one or more scenes, where the previously-derived perception data includes a respective set of object-level information for each of a plurality of objects detected within the sequence of frames, (ii) derive supplemental object-level information for at least one object detected within the sequence of frames that adds to the previously-derived object-level information for the at least one object, (iii) augment the previously-derived perception data to include the supplemental object-level information for the at least one object, and (iv) store the augmented perception data in an arrangement that encodes a hierarchical relationship between the plurality of objects, the sequence of frames, and the one or more scenes.

Systems and methods for augmenting perception data with supplemental information

Methods, systems, and devices are provided for calibrating a light ranging system and using the system to track environmental objects. In embodiments, the approach involves installing light ranging devices, such as lidar devices, on the vehicle exterior. The light ranging system may be calibrated using a calibration device to scan the vehicle exterior and construct a three-dimensional model of the vehicle exterior comprising the positions of the installed light ranging devices on the vehicle exterior. The calibrated light ranging system may use the model in conjunction with ranging data collected by the installed light ranging devices to track objects in the environment. In this way, the light ranging system may detect a proximity of environmental objects and help a driver of the vehicle avoid potential collisions. The light ranging system may further measure the vehicle exterior and thereby detect changes to the vehicle exterior.

Monitoring of vehicles using light ranging systems

Growing community of inventors

San Francisco, CA, United States of America

Mushfiqur Rouf