The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 14, 2026
Filed:
Dec. 13, 2024
Accenture Global Solutions Limited, Dublin, IE;
Kaushik Amar Das, Guwahati, IN;
Sankar Narayan Das, Barrackpore, IN;
Kuntal Dey, Birbhum, IN;
Samdyuti Suri, Faridabad, IN;
Vikrant Kaulgud, Bangalore, IN;
Teresa Sheausan Tung, Los Angeles, CA (US);
Adam Patten Burden, Tampa, FL (US);
ACCENTURE GLOBAL SOLUTIONS LIMITED, Dublin, IE;
Abstract
A computer-implemented method for cost and carbon aware large language model (LLM) cache management is disclosed. The method includes: determining whether a prompt matching an input prompt exists in a plurality of prompts stored in a cache memory; upon determining that the prompt matching the input prompt exists in the cache memory, returning a response associated with the prompt from the cache memory; otherwise, (a) invoking the LLM and returning a response generated by the LLM, (b) updating the cache memory with the input prompt and the associated response obtained from the LLM as an entry in the cache memory, (c) estimating an operational cost and a carbon cost associated with generating the response to the input prompt, (d) fetching data associated with the LLM, and (e) updating the operational cost, the carbon cost and the data associated with the LLM as metadata of the entry in the cache memory.