Motional Ad LLC

Calin Belta

Radboud Duintjer Tebbens

Anne Collin

Tichakorn Wongpiromsarn

Oscar Olof Beijbom

Bassam Helou

Amitai Bin-Nun

Hsun-Hsien Chang

Emilio Frazzoli

Kostyantyn Slutskyy

Dmytro S Yershov

Noushin Mehdipour

Shakiba Yaghoubi

Provided are methods for trajectory generation based on a hierarchical plurality of rules using diverse trajectories, which can include generating a first set of trajectories for a vehicle from a first pose, identifying a first trajectory and a second trajectory from the first set of trajectories, generating a second set of trajectories for the vehicle from a second pose and a third set of trajectories for the vehicle from a third pose, identifying a third trajectory based at least in part on the second set of trajectories and the third set of trajectories, the third trajectory violating a first behavioral rule associated with a first priority that is less than a priority of behavioral rules violated by other trajectories, and determining a path for the vehicle based at least in part on the third trajectory. Systems and computer program products are also provided.

Trajectory generation utilizing diverse trajectories

In an example method, a computer system receives first data representing a plurality of scenarios for estimating a performance of a vehicle in conducting autonomous operations. Further, the computer system determines, for each of the scenarios: (i) a first metric indicating an observed performance of the vehicle in that scenario, where the first metric is determined based on at least one rule, and (ii) a second metric indicating a degree of information gain associated with that scenario. The computer system selects a subset of the scenarios based on the first metrics and the second metrics, and outputs second data indicative of the subset of the scenarios.

Selecting testing scenarios for evaluating the performance of autonomous vehicles

Enclosed are embodiments for scoring one or more trajectories of a vehicle through a given traffic scenario using a machine learning model that predicts reasonableness scores for the trajectories. In an embodiment, human annotators, referred to as a 'reasonable crowd,' are presented with renderings of two or more vehicle trajectories traversing through the same or different traffic scenarios. The annotators are asked to indicate their preference for one trajectory over the other(s). Inputs collected from the human annotators are used to train the machine learning model to predict reasonableness scores for one or more trajectories for a given traffic scenario. These predicted trajectories can be used to rank trajectories generated by a route planner based on their scores, compare AV software stacks, or used by any other application that could benefit from a machine learning model that scores vehicle trajectories.

Scoring autonomous vehicle trajectories using reasonable crowd data

Enclosed are embodiments for scenario-based behavior specification and validation. In an embodiment, a method comprises: obtaining, using at least one processor, at least one trajectory associated with a driving scenario for an autonomous vehicle system; evaluating, using the at least one processor and at least one rulebook, the at least one trajectories to determine whether the at least one trajectory violates at least one rule in the at least one rulebook, wherein each rule in the rulebook is associated with at least one violation metric that is used to determine a degree to which the rule was satisfied or violated; determining, using the at least one processor and the at least one violation metric, a score for the at least one trajectory; and sending, using the at least one processor, the score to at least one of a software module in a software stack of the autonomous vehicle system, a simulation of the autonomous vehicle system or as a report or in a visual presented through a user interface of a cloud-based platform.

Scenario-based behavior specification and validation

Growing community of inventors

Sherborn, MA, United States of America

Calin Belta