The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 11, 2025
Filed:
Dec. 02, 2024
Vijay Madisetti, Alpharetta, GA (US);
Vijay Madisetti, Alpharetta, GA (US);
Arshdeep Bahga, Chandigarh, IN;
[object Object];
Abstract
A system for processing LLM operations including a memory module, a data receiver to receive an input data stream and break the input data stream into batches of input data, a processing layer to process the batches of input data in the one or more memory modules and having LLMs to process the batches of input data and generate corresponding batches of processed output data and an output broker to cache results from the plurality of LLMs in a results cache, assign priority scores to the cached results, rank the cached results based on their priority scores, and provide ranked results responsive to subsequent similar input data received by the data receiver from the results cache.