logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 12566928 B1

PDFFull Text
Date of Patent:
Mar. 03, 2026

Filed:

Apr. 27, 2023

Readability based confidence score for large language models

Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Shima Imani, Sammamish, WA (US);

Harsh Shrivastava, Redmond, WA (US);

Assignee:

Microsoft Technology Licensing, LLC, Redmond, WA (US);

Attorneys:

Ray Quinney & Nebeker P.C.

Tiffany B. Healy

Primary Examiner:

Bhavesh M Mehta

Assistant Examiner:

Eunice undefined Lee

Int. Cl.
CPC ...
G06F 40/40 (2020.01); G06F 40/205 (2020.01);
U.S. Cl.
CPC ...
G06F 40/40 (2020.01); G06F 40/205 (2020.01);
Abstract

The present disclosure relates to methods and systems that generate a confidence score for the generated large language model (LLM) output. The methods and systems use the text of the input provided to the LLM and the text from the generated LLM output to produce a feature vector that encodes a readability of the text from the input and the text of the LLM output. The feature vector is used to determine a corresponding confidence score for the generated LLM output. The confidence score is used to evaluate a quality of the generated LLM output.

Find Patent Forward Citations

Imani, Shima. (2026). Readability based confidence score for large language models (U.S. Patent No. 12566928). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12566928

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…