Bang Fu

Chao Xie

Xiaofan Luan

Xiangyu Wang

The method is applied to a question-answering system including large language model. The question-answering system can store history query information to vector database, and store history query results corresponding to each history query information to scalar database. When receiving the current query request, the question-answering system may first match the current query request with the history query information. If the history query information contains target history query information matching the current query request, the query result of the current query request can be obtained based on the target history query result corresponding to the target history query information. Hence, the question-answering system does not need to obtain the query result by LLM inferring, which is beneficial to reducing the delay of obtaining the query result by the question-answering system and reducing the operation cost of the question-answering system.

Growing community of inventors

Shanghai, China

Bang Fu