Backward monte carlo tree search model for monitoring and analyzing safety of belief reasoning for autonomous vehicles

Abstract

A vehicle traversing a vehicle transportation network may use a scenario-specific operational control evaluation model instance. The vehicle may receive operational environment data that includes data associated with an object external to the vehicle. The vehicle may determine, based at least in part on the data associated with the object, a final belief associated with an undesired outcome. The vehicle may construct a backward Monte Carlo tree search model based on the final belief and may determine, based on the backward Monte Carlo tree search model, a set of initial beliefs corresponding to a likelihood of leading to the final belief within a timestep threshold. A policy may be trained using the set of initial beliefs. Based on the trained policy, a set of candidate vehicle control actions may be determined, and a vehicle control action may be selected from the set of candidate vehicle control actions.