The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 04, 2025

Filed:

Jul. 03, 2023
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Yao Qian, Bellevue, WA (US);

Yu Wu, Beijing, CN;

Kenichi Kumatani, Sammamish, WA (US);

Shujie Liu, Beijing, CN;

Furu Wei, Beijing, CN;

Nanshan Zeng, Bellevue, WA (US);

Xuedong David Huang, Yarrow Point, WA (US);

Chengyi Wang, Jinan, CN;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G10L 15/187 (2013.01); G06N 20/00 (2019.01); G10L 15/02 (2006.01); G10L 15/06 (2013.01); G10L 15/22 (2006.01);
U.S. Cl.
CPC ...
G10L 15/187 (2013.01); G06N 20/00 (2019.01); G10L 15/02 (2013.01); G10L 15/063 (2013.01); G10L 15/22 (2013.01); G10L 2015/025 (2013.01);
Abstract

A system obtains a first training data set comprising labeled speech data or both labeled and unlabeled data corresponding to a high-resource data set as well as latent speech representations based on the first training data set. The system trains a machine learning model on the first training data set to learn phonetically aware speech representations corresponding to the first training data set. The system applies the latent speech representations to a transformer context network to generate contextual representations. The system aligns each of the contextual representations with a phoneme label to generate phonetically-aware contextual representations. The system causes a refinement engine to further refine the machine learning model.


Find Patent Forward Citations

Loading…