The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 08, 2022

Filed:

Jul. 19, 2019
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Jinyu Li, Redmond, WA (US);

Amit Kumar Agarwal, Redmond, WA (US);

Yifan Gong, Sammamish, WA (US);

Harini Kesavamoorthy, Bengaluru, IN;

Changliang Liu, Bellevue, WA (US);

Liang Lu, Remond, WA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G10L 15/16 (2006.01); G10L 15/14 (2006.01); G06F 40/149 (2020.01); G06N 3/04 (2006.01);
U.S. Cl.
CPC ...
G10L 15/142 (2013.01); G06F 40/149 (2020.01); G06N 3/049 (2013.01); G10L 15/16 (2013.01);
Abstract

Streaming machine learning unidirectional models is facilitated by the use of embedding vectors. Processing blocks in the models apply embedding vectors as input. The embedding vectors utilize context of future data (e.g., data that is temporally offset into the future within a data stream) to improve the accuracy of the outputs generated by the processing blocks. The embedding vectors cause a temporal shift between the outputs of the processing blocks and the inputs to which the outputs correspond. This temporal shift enables the processing blocks to apply the embedding vector inputs from processing blocks that are associated with future data.


Find Patent Forward Citations

Loading…