Self-supervised learned model for controlling a vehicle

Abstract

There is provided a system configured to receive data associated with a vehicle operating within an environment; generate, based at least in part on the data, a graph comprising a plurality of nodes, a node of the plurality associated with one or more of a vehicle operating in the environment, a road feature, an additional vehicle, or a pedestrian; input the graph into a self-supervised machine learned model comprising an encoder, wherein the machine learned model is trained to output a representation associated with the node; receive, from the self-supervised machine learned model, a representation associated with the node; and transmit the representation to a downstream machine learned model trained to output control data based at least in part on the representation, wherein the control data is configured to control the vehicle or another vehicle.