System and method of supporting question answering using large language models

Abstract

An overlap amount is defined for each document type. For each document, a system cuts the document into a plurality of document chunks according to the overlap amount corresponding to the type of document, and if the document type of the document is a predetermined document type, for each document type, the system associates the document chunk with a dictionary chunk that contains descriptions about a word that matches a word in the document chunk. When the system receives a user question, the system generates and provides an answer by inputting the question, as well as a document chunk identified based on the question and a dictionary chunk which the document chunk is associated with, into an LLM.