Named entity recognition in search queries

Abstract

Named Entity Recognition (NER) in a user search query in a real-time search engine may be achieved by training a machine learning algorithm to create a trained model. The trained model may be configured to receive a user search query as input and to recognize and output zero or more named entities in the search query. The training may include an iterative training process in which further training data is added at each iteration, in some embodiments. The training may be based on three training data sets, in some embodiments. A first training data set may be based on user search and engagement activity. A second training data set may be artificially generated based on a catalog of named entity values. A third training data set may be based on optimized and supplemented data pairs sampled from the first training data set.