The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 14, 2025
Filed:
May. 02, 2023
International Business Machines Corporation, Armonk, NY (US);
Ohio State Innovation Foundation, Columbus, OH (US);
Samuel Thomas, White Plains, NY (US);
Vishal Sunder, Columbus, OH (US);
Hong-Kwang Kuo, Pleasantville, NY (US);
Brian E. D. Kingsbury, Cortlandt Manor, NY (US);
Eric Fosler-Lussier, Columbus, OH (US);
George Andrei Saon, Stamford, CT (US);
International Business Machines Corporation, Armonk, NY (US);
Ohio State Innovation Foundation, Columbus, OH (US);
Abstract
Systems, computer-implemented methods, and computer program products to facilitate fine-grained textual knowledge transfer to improve speech recognition and understanding are provided. According to an embodiment, a system can comprise a processor that executes components stored in memory. The computer executable components comprise deriving component that can derive one or more speech-based embeddings from an utterance via a speech encoder. The computer executable components can comprise a cross-attention component that can align, at a token level, one or more large language model (LLM) based sentence embeddings with the one or more speech-based embeddings. The computer executable components can comprise a loss component that can combine an alignment loss and an automatic speech recognition (ASR) loss.