The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 04, 2025
Filed:
May. 04, 2023
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Matthew Jonathan Gardner, Irvine, CA (US);
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
Systems and methods are provided for implementing confidence enhancement for responses by document-based large language models ('LLMs') or other AI/ML systems. A first prompt is generated based on data items that are previously received or accessed. The first prompt is used by a first LLM or AI/ML system to extract requested information from the data items. One or more citations are generated and presented within a structured object together with a representation of the extracted information, in some cases, as output from a second LLM or AI/ML system. In some cases, the citations and/or the representation may be verified by a third LLM or AI/ML system, and reliability indicators may be generated for the citations and/or the representation based on determined accuracy of the citations and/or the representation. In this manner, the common issue of hallucinations may be mitigated.