Retrieval-augmented generation and relevancy annotation to abort impact of irrelevant queries using generative artificial intelligence

Abstract

Methods and systems provide content searching and retrieval using generative artificial intelligence (AI) Models. The system is configured to receive a user search for content, media or item listings. The system receives a natural language-based input associated with a client device of a user. The system generates a search criterion for the received natural language-based input. The system provides a data set of retrieved content items to one or more large language models that annotate each of the content items in the data set. The system receives a new data set with the content items each including a relevancy annotation. Based on the relevancy annotations in the new data the system determines what additional processing to perform.