System and method of gamified active learning for vehicle perception systems

Abstract

A system and method of gamified learning for a vehicle is provided. The system includes a perception model configured to receive perception data from a camera, execute a perception task to obtain a task result for the object, determine the perception confidence level of the task result is below a predetermined perception confidence threshold, show an image of the object to an on-scene user, request the on-scene user to annotate the object, and reward the on-scene user in response to receiving the annotation from the on-scene user. The system further includes a server configured to aggregate a plurality of annotations from a plurality of users, apply a probabilistic model to determine a ground truth annotation, and input the ground truth annotation and an image to a machine learning model to update the perception model.