The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 05, 2024
Filed:
Jun. 28, 2024
Citibank, N.a., New York, NY (US);
William Franklin Cameron, Jacksonville, FL (US);
Miriam Silver, Tel Aviv, IL;
Manjit Rajaretnam, Irving, TX (US);
Abstract
Systems and methods for evaluating a pre-trained artificial intelligence (AI) model using layered prompts. The system obtains a set of application domains in which the AI model will be used, and a set of guidelines that define one or more operational boundaries of the AI model. The system determines a set of layers, where each layer is associated with corresponding guidelines and mapped to a set of variables and benchmarks. Each variable represents an attribute within the guidelines and each benchmark indicates the degree of satisfaction of the AI model with the guidelines. The AI model is dynamically evaluated against these benchmarks using a series of assessments. Subsequent assessments are dynamically constructed based on the outcomes of previous assessments. Scores are assigned to the AI model for each layer by comparing the expected and actual responses. The results are then displayed in a graphical user interface (GUI).