The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 25, 2026
Filed:
Jul. 21, 2023
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Lesly Sadiht Miculicich Werlen, Kirkland, WA (US);
Pengcheng He, Sammamish, WA (US);
Yujia Xie, Redmond, WA (US);
Wei Xiong, Bellevue, WA (US);
Siqing Chen, Bellevue, WA (US);
Xun Wang, Amherst, MA (US);
Elsie Prasuna Nallipogu, Bellevue, WA (US);
Yanling Xiong, Sammamish, WA (US);
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
A technique is described for compressing input information fed to a machine-trained generative model. The technique includes: receiving original input information having a plurality of sentences; performing word-level encoding of the original input information using a first part of a machine-trained transformer model, to provide word-level encoded information; performing sentence-level encoding of the word-level encoded information using a second part of the machine-trained transformer model, to provide scores associated with the first plurality of sentences; selecting a subset of the sentences in the original input information based on the scores, to provide modified input information; and providing the modified input information to the machine-trained generative model. The operation of word-level encoding performs parallel processing on portions of the original input information. Overall, the compressing operation enables the machine-trained generative model to process the original input information with reduced resources and latency.