Google Inc.

Basi Garcia

Tara N Sainath

Ruoming Pang

Trevor D Strohman

Richard Cameron Rose

David Rybach

Otavio Braga

Takaki Makino

Hank Liao

Oliver Siohan

A method includes receiving a training example that includes audio data representing a spoken utterance and a ground truth transcription. For each word in the spoken utterance, the method also includes inserting a placeholder symbol before the respective word identifying a respective ground truth alignment for a beginning and an end of the respective word, determining a beginning word piece and an ending word piece, and generating a first constrained alignment for the beginning word piece and a second constrained alignment for the ending word piece. The first constrained alignment is aligned with the ground truth alignment for the beginning of the respective word and the second constrained alignment is aligned with the ground truth alignment for the ending of the respective word. The method also includes constraining an attention head of a second pass decoder by applying the first and second constrained alignments.

Emitting word timings with end-to-end models

Growing community of inventors

Mountain View, CA, United States of America

Basi Garcia