Context aware optimization of planner for autonomous driving

Abstract

Systems and methods for optimizing a planning model for autonomous driving. Image data is generated from a vehicle camera. A perception model detects agents in the environment based on the image data. A planner model is executed to generate a predicted trajectory of the vehicle based upon configuration parameters associated with characteristics of the vehicle. Information regarding a context associated with the detected agents is received from the perception model. An optimizer is configured to select a subset of the configuration parameters to be optimized based on the context, select an objective function based on the context, adjust the selected subset of configuration parameters based on a current value of the objective function, generate a new planned trajectory, derive a value of the objective function, and determine optimal configuration parameters that minimize the objective function.