Semantic search architecture for information retrieval with natural language queries

Abstract

Techniques are disclosed relating to operating, by a computer system, a semantic search engine to retrieve records from a data store. The technique includes training, by the computer system using a plurality of training data sets that include queries and corresponding records, a retrieval model for use in the semantic search engine. The technique may further include generating, by the trained retrieval model, a particular output vector representing a received semantic search query, and generating, using the particular output vector, a respective similarity score for ones of candidate records identified in the data store. The trained retrieval model may send the particular output vector to a late interaction model, and the late interaction model may sort, using the particular output vector, candidate records with respective similarity scores that satisfy a threshold score.