Displaying updated vehicle behavior in real time visualizations

Abstract

Aspects of the technology employs snapshots, which are serialized sets of inputs for evaluating a components of a vehicle's autonomous driving system. Snapshots can be performed very quickly with minimal compile latency and runtime, allowing rapid evaluation of individual autonomous vehicle elements in isolation. Parameter variation and changes to initial conditions associated with a given component may be applied via a robust user interface (UI), enabling a user to perform permutations to a component or scenario and receive immediate feedback, e.g., graphically presented in a three-dimensional (3D) scene to understand how the vehicle is operating. The UI may include various control elements to enable real-time adjustment to the parameters or conditions of a snapshot. This can include one or more mutations of a snapshot to evaluate different situations or conditions, which can further aid in understanding how the vehicle would function in an autonomous driving mode.