Systems and methods for path planning with latent state inference and graphical relationships

Abstract

Systems and methods for path planning with latent state inference and spatial-temporal relationships are provided. In one embodiment, a system includes an inference module, a policy module, a graphical representation module, and a planning module. The inference module receives sensor data associated with a plurality of agents. The inference module maps the sensor data to a latent state distribution to identify latent states of the plurality of agents. The latent states identify agents as cooperative or aggressive. The policy module predicts future trajectories of the plurality of agents at a given time based on sensor data and the latent states of the plurality of agents. The graphical representation module generates a graphical representation based on the sensor data and a graphical representation neural network. The planning module generates a motion plan for the ego agent based on the predicted future trajectories and the graphical representation.