Goldman Sachs &Co. LLC

Eliot P Brenner

Dinesh Gupta

Koustuv Dasgupta

Tianlong Xu

Manjunath G Hegde

Goncalo Nuno Ventura De Melo

Abdallah Mohamed Abdo Mohamed Bashir

Amy Francesca Pajak

A method includes obtaining chunks of information and generating training samples for an embedding model using the chunks of information. Generating the training samples includes using at least one large language model to generate training samples in which different ones of the chunks of information are and are not relevant to different potential queries. The method also includes training the embedding model using the training samples. In some cases, the embedding model may represent a retriever model. For example, an input query may be obtained at the retriever model, and the retriever model may be configured to identify a specified number of chunks of information relevant to the input query. One or more of the chunks of information may be provided from the retriever model to a generative model, and the generative model may be used to create a response to the input query.

Data generation and retraining techniques for fine-tuning of embedding models for efficient data retrieval

A method includes obtaining an input query at a retriever model, where the retriever model includes a reconfigurable sequence of one or more rankers selected from among a plurality of rankers. Each ranker is configured to identify a specified number of information chunks relevant to the input query. The method also includes providing one or more of the information chunks from the retriever model to a generative model. The method further includes using the generative model to create a response to the input query, where the response is based on the one or more information chunks. The plurality of rankers includes a bi-encoder, a cross-encoder, and a large language model (LLM)-ranker.

Generative machine learning with retriever having reconfigurable sequence of rankers

Growing community of inventors

Westfield, NJ, United States of America

Eliot P Brenner