The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 15, 2026
Filed:
Oct. 21, 2025
Intuit Inc., Mountain View, CA (US);
Shai Ardazi, Petah Tikva, IL;
Matan Vetzler, Petah Tikva, IL;
Ofir Ben Shoham, Petah Tikva, IL;
Sagiv Antebi, Petah Tikva, IL;
Intuit Inc., Mountain View, CA (US);
Abstract
Computer-aware caching for low latency large language model (LLM) serving includes detecting an idle time of a hardware processor while monitoring the hardware processor, triggering, in response to detecting idle time, a LLM to generate a candidate set that includes a request and a response from a raw chat log, generating a candidate set embedding from the request, and storing the candidate set with the candidate set embedding in a data repository to generate a cached candidate set that includes a cached request and a cached response. The candidate set is retrieved using the candidate set embedding matching a user request embedding and verified based on a semantic equivalence between the cached request and a user request.
Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile