Google Inc.

Mohammadinamul Hasan Sheik

Diego Melendo Casado

Yu Ouyang

Francoise Beaufays

Dragan Zivkovic

Meltem Oktem

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

Growing community of inventors

San Jose, CA, United States of America

Mohammadinamul Hasan Sheik