Generative artificial intelligence to pre-train and fine-tune models for multiple autonomous vehicle future trajectories

Abstract

Disclosed are embodiments for facilitating generative artificial intelligence (AI) to pre-train and fine-tune models for multiple autonomous vehicle (AV) trajectories generation. In some aspects, an embodiment includes training a teacher generative AI model on a first set of training data; providing a student generative AI model with at least one distillation of the teacher generative AI model, the at least one distillation comprising transformer weights, embeddings, or predictions labels of the teacher generative AI model; training the student generative AI model that is initialized with the at least one distillation of the teacher generative AI model, wherein the student generative AI model is trained using a second set of training data that is smaller than the first set of training data; and deploying the student generative AI model to a resource-constrained environment.