Citibank, N.a.

Youval Bitner

Jason Ryan Engelbrecht

John E Ortega, Jr

Alberto Cetoli

Joel Branch

The systems and methods disclosed herein generates responses generated by artificial intelligence (AI) models such as large language models (LLM) using intent-based rankings of retrieved information. The systems and methods disclosed herein receives an output generation request for the generation of an output using a set of AI models. Using a first AI model, a set of documents are retrieved using the received output generation request. The set of documents are partitioned into chunks. The chunks are ranked using a distance between the vector representation of the received output generation request and the vector representation of each chunk. A second AI model classifies the output generation request and chunks using an intent of the respective output generation request or chunk, and generates a second set of rankings using the intents. The set of AI models generate a response using the second set of rankings.

Using intent-based rankings to generate large language model responses

The systems and methods disclosed herein generate context-aware responses using semantically chunked information. The systems and methods disclosed herein partition a set of artifacts responsive to a query (e.g., a prompt for an artificial intelligence model such as a large language model) into a set of continuous chunks and associate each continuous chunk with a knowledge graph. The knowledge graph includes nodes representing chunks and edges indicating common attributes. The systems and methods disclosed herein modify node(s) in the graph by determining values of feature variables and adjusting edges in accordance with the values and generate contextualized chunks by associating or linking continuous chunks of node pairs using shared edges. The systems and methods disclosed herein use the contextualized chunks and query to generate a response using the artificial intelligence model.

Growing community of inventors

New York, NY, United States of America

Youval Bitner