The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 20, 2026

Filed:

Aug. 29, 2024
Applicant:

Accenture Global Solutions Limited, Dublin, IE;

Inventors:

Kamakshi Subramaniam, Rochester, MI (US);

Atish Shankar Ray, Herndon, VA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 16/27 (2019.01); G06F 16/2453 (2019.01); G06F 16/2455 (2019.01);
U.S. Cl.
CPC ...
G06F 16/24539 (2019.01); G06F 16/24552 (2019.01); G06F 16/27 (2019.01);
Abstract

Method, system, and computer-readable media for adaptive caching of a response generated by a Large Language Model (LLM) for a received prompt is disclosed. Data associated with the response and the received prompt is processed. A respective value of each of a plurality of features is updated to generate a discrete time series based upon the data. Further, a plurality of caching metrics is generated based upon a plurality of respective values of one or more features of the plurality of features. A safety score corresponding to the plurality of caching metrics is generated. The data based, at least in part, upon the safety score, a response time predicted for a request associated with the received prompt, and metadata, are stored in a caching database.


Find Patent Forward Citations

Subramaniam, Kamakshi. (2026). Adaptive caching of model responses (U.S. Patent No. 12769735). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12769735

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…