Lyft, Inc.

Woven by Toyota, U.s., Inc.

Woven Planet North America, Inc.

Shaojing Li

David Tse-Zhou Lu

Vinay Shet

Ying Liu

Shaohui Sun

Weiyi Hou

Ivan Kirigin

Lina Dong

Robert Charles Kyle Pinkerton

Somesh Khandelwal

Luc Vincent

Sameer Qureshi

Jared Gregory Wood

Yingting Xiao

Erik Behar

Jasper Fionn Friedrichs

Snow Li

Thien Tran Vo

Systems, methods, and non-transitory computer-readable media can access a plurality of schema-based encodings providing a structured representation of an environment captured by one or more sensors associated with a plurality of vehicles traveling through the environment. The plurality of schema-based encodings can be clustered into one or more clusters of schema-based encodings. At least one scenario associated with the environment can be determined based at least in part on the one or more clusters of schema-based encodings.

Approaches for encoding environmental information

Systems, methods, and non-transitory computer-readable media can determine sensor data captured by at least one sensor of a vehicle while navigating an environment over a period of time. Information describing one or more agents associated with the environment during the period of time can be determined based at least in part on the captured sensor data. A schema-based encoding describing the environment during the period of time can be generated based at least in part on the determined information and a scenario schema, wherein the schema-based encoding provides a structured representation of the environment during the period of time.

A method includes generating, while a vehicle is operating in an autonomous-driving mode, a planned trajectory associated with a computing system of the vehicle based on first sensor data capturing an environment of the vehicle. The method further includes, while the vehicle is operating according to the planned trajectory, receiving a disengagement instruction associated that causes the vehicle to disengage from operating in the autonomous-driving mode and switch to operating in a disengagement mode. Subsequent to the vehicle operating in the disengagement mode, the method further includes capturing second sensor data and generating a simulation of the environment. The simulation is based on sensor data associated with the environment and the planned trajectory. Additionally, subsequent to the vehicle operating in the disengagement mode, the method concludes with evaluating a performance of an autonomy system based on the simulation, and providing feedback based on the evaluation.

Vehicle disengagement simulation and evaluation

In one embodiment, a method includes receiving a request for evaluating driving data included in a data log, accessing, based on the request, an evaluation configuration file that includes a metric-calculation configuration specifying one or more metric calculators configured to generate one or more output metrics from the driving data and a validation configuration configured to validate the one or more output metrics, instantiating the one or more metric calculators specified by the metric-calculation configuration included in the evaluation configuration file, determining particular driving data from the driving data included in the data log based on the one or more instantiated metric calculators, and generating the one or more output metrics for the particular driving data by using the instantiated one or more metric calculators.

Evaluating driving data with a modular and configurable evaluation framework

In one embodiment, a computing system of a vehicle generates perception data based on sensor data captured by one or more sensors of the vehicle. The perception data includes one or more representations of physical objects in an environment associated with the vehicle. The computing system further determines simulated perception data that includes one or more representations of virtual objects within the environment and generates modified perception data based on the perception data and the simulated perception data. The modified perception data includes at least one of the one or more representations of physical objects and the one or more representations of virtual objects. The computing system further determines a path of travel for the vehicle based on the modified perception data, which includes the one or more representations of the virtual objects.

Simulation architecture for on-vehicle testing and validation

Systems, methods, and non-transitory computer-readable media can access a first set of schema-based encodings associated with a first environment, wherein a schema-based encoding provides a structured representation of an environment based on a scenario schema. First information representing scenario information associated with the first environment can be generated based at least in part on the first set of schema-based encodings. One or more attributes for the first environment can be determined based at least in part the first information.

Growing community of inventors

Mountain View, CA, United States of America

Shaojing Li