Systems and methods for providing improved retrieval augmented generation (rag) for query response

Abstract

Systems and methods for providing improved retrieval augmented generation for query response, retrieve key-value pairs from a key-value pairs database; index the key-value pairs into vector stores, wherein a first vector store contains the keys from the key-value pairs, a second vector store contains the values from the key-value pairs, and a third vector store contains value chunks of the values; process a query through the first and third vector stores to generate a list of keys and a list of value chunks from their respective stores; retrieve, from the second vector store, corresponding values to the keys in the list of keys from the first vector store; compose, an augmented prompt based on an aggregation of the query, the list of keys, the corresponding values, and at least a portion of the value chunks; and generate a proposed response by feeding the augmented prompt into a large language model.