Intent-based task representation learning using weak supervision

Abstract

Systems and methods are described that are generally directed to generating a general task embedding representing task information. In examples, the generated task embedding may include predicted task information such that, rather being underspecified, the task embedding representative of the task may include additional specified information, where the task embedding can then be utilized in many different models and applications. Thus, task data may be received and at least a portion of the task data may be encoded using an encoder. Based on one or more outputs generated by the encoder and a type embedding associated with the task data, a task intent may be extracted or otherwise predicted based on the task data and one or more type encodings associated with the task data. The intent extractor may be trained on multiple auxiliary tasks with weak supervision that provide semantic augmentation to under-specified task texts.