Few shot incremental learning for named entity recognition

Abstract

A method, computer system, and a computer program product for classification training are provided. A deep learning model is trained with a first dataset that includes annotated samples that include a first and second class. Last hidden state features corresponding to respective tokens from prototypes of the first and second class are saved. The trained deep learning model is further trained with a second dataset that includes additional annotated samples that include the first and second class and a third class. The further training includes performing a cosine similarity loss optimization and a cross entropy loss optimization. The cosine similarity loss optimization is of last hidden state features resulting from the further trained deep learning model and the first class and the second class compared to the saved last hidden state features. The cross entropy loss optimization is for classification of the first, second, and the third class.