The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 22, 2026
Filed:
Aug. 28, 2024
Accenture Global Solutions Limited, Dublin, IE;
Kamakshi Subramaniam, Rochester, MN (US);
Atish Shankar Ray, Herndon, VA (US);
Accenture Global Solutions Limited, Dublin, IE;
Abstract
A computer-implemented method for evaluating integration of Responsible Artificial Intelligence Operations (RAIOPS) and Large Language Model Operations (LLMOPS) is disclosed. A response respective to each of prompts is generated using an LLM, in response to receiving data associated with each of the prompts. The data associated with each of the prompts and data associated with the response respective to each of the prompts is stored as an association. Further, based on user-specified criteria and using the data associated with the prompts or the data associated with the responses respective to the prompts, one or more evaluation metrics are generated for evaluating the responses respective to each of the prompts for one or more aspects. In accordance with the at least one evaluation metric, a knowledge graph visualization or a numerical score is generated to display performance of the LLM and determine whether the LLM needs optimization or tuning.