Testing autonomous vehicle control performance based on dynamic input data

Abstract

Techniques for verifying operation of testing mechanisms are discussed herein. For example, a computing device can implement a testing component to test performance of a vehicle controller configured to control operation of a vehicle. The testing component can apply one or more heuristics and/or machine learned models to initiate, perform, and analyze tests that measure whether an instruction update improves performance of the vehicle controller and/or whether the instruction update causes performance of another component to degrade. The testing component can be used to validate the instruction update in a testing environment prior to transmitting the instruction update to a vehicle controller coupled to a vehicle in a real-world environment.