The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Apr. 16, 2024
Filed:
Dec. 29, 2023
Theai, Inc., Mountain View, CA (US);
Ilya Gelfenbeyn, Palo Alto, CA (US);
Mikhail Ermolenko, Mountain View, CA (US);
Kylan Gibbs, San Francisco, CA (US);
Evgenii Shingarev, Mountain View, CA (US);
Theai, Inc., Mountain View, CA (US);
Abstract
Systems and methods for pre-fetching results from large language models (LLMs) are provided. The method includes acquiring a context of an interaction between a user and an Artificial Intelligence (AI) character; predicting, based on the context, one or more anticipated words to be uttered by the user; generating, based on the one or more anticipated words, at least one query to an LLM; providing the at least one query to the LLM; generating, based on at least one response obtained from the LLM, an anticipated reply of the AI character model to the one or more anticipated words to be pronounced by the user; receiving one or more words uttered by the user; determining that a level of a discrepancy between the one or more words and the one or more anticipated words is below a predetermined threshold; and providing the anticipated reply to the user.