Argo Ai Gmbh

Patrick Michael Carmody

Thomas Carl Ackenhausen

Albert Costa

Arjuna Ariyaratne

Alexander Allen Nolley

This document discloses system, method, and computer program product embodiments for operating an autonomous vehicle (AV). For example, the method includes performing the following operations by a muxing tool when AV is deployed within a particular geographic area in a real-world environment: receiving perception data that is representative of at least one actual object which is perceived while AV is deployed within the particular geographic area in a real-world environment; receiving simulation data that represents a simulated object that could be perceived by AV in the real-world environment and that was generated using a simulation scenario which is selected from a plurality of simulation scenarios based on at least one of the particular geographic area in which AV is currently located and a current operational state of AV; and generating augmented perception data by combining the simulation data with the perception data.

In-vehicle operation of simulation scenarios during autonomous vehicle runs

This document describes methods by which an autonomous vehicle deploys a simulation scenario while operating in a real-world environment. The vehicle's sensors collect perception data. During a run of the vehicle in a real-world environment, the vehicle's on-board computing system will: (i) receive the perception data; (ii) publish the perception data to a muxing tool of the on-board computing system; (iii) generate simulation data that identifies and labels one or more simulated objects in the environment; (iv) publish the simulation data to the muxing tool; (v) use the muxing tool to add at least a portion of the simulation data to the perception data to yield augmented perception data; and (v) use at least a portion of the augmented perception data to make one or more navigation decisions based for the autonomous vehicle.

A system of creating a simulation scenario definition to simulate behavior of an autonomous vehicle includes a computing device and a computer-readable storage medium having one or more programming instructions. The system identifies an event on which a simulation scenario definition is to be based, identifies one or more log files associated with the event, parses the one or more log files in a time-sequential order and populates the simulation scenario definition with information from the identified log files until an event trigger is detected, identifies an actor from one or more of the log files, infer a shape of the actor, generates one or more simulated tracks that includes the inferred shape for the actor, and adds the simulated tracks to the simulation scenario definition.

Systems and methods for generating simulation scenario definitions for an autonomous vehicle system

A system of creating a simulation to simulate behavior of an autonomous vehicle includes a simulation system having an electronic device and a computer-readable storage medium having one or more programming instructions. When executed, the one or more programming instructions cause the electronic device to identify an event that is to be analyzed, receive from an autonomous vehicle system a first data stream that includes event information from one or more vehicle event log files that corresponds to the event, receive from a vehicle dynamics model a second data stream that includes synthetic event information that corresponds to the event, until a switch point is detected operate in a pure log execution stage, upon detection of the switch point operate in a play-forward execution stage, and cause the new simulation to be executed.

Growing community of inventors

Dexter, MI, United States of America

Patrick Michael Carmody