The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 14, 2026
Filed:
Feb. 29, 2024
Intuit Inc., Mountain View, CA (US);
Siddharth Jain, Mountain View, CA (US);
Shraddhaben Padariya, Mountain View, CA (US);
Venkat Narayan Vedam, Mountain View, CA (US);
INTUIT INC., Mountain View, CA (US);
Abstract
Aspects of the invention provide a method, computer system, and computer program product for evaluating language model responses. A set of user-defined objectives for evaluating model responses generated by a large language model is received. The objectives include semantic accuracy, grammatical soundness, and expert alignment. A set of evaluation metrics are selected from a predefined library based on the user-defined objectives. Evaluation scores are determined for model responses generated by a large language model using the selected set of metrics. The evaluation scores include a semantic score and a lexical score. A composite score is calculated from the evaluation scores. The composite score is adjusted for divergences between the semantic score and the lexical score. A set of hyperparameters of the large language models is tuned based on the composite score. The tuning customizes the large language model according to the user-defined objectives.