Microsoft Technology Licensing, LLC

Huakai Liao

Amit Srivastava

Derek Martin Johnson

Priyanka Vikram Sinha

Siliang Kang

Huey-Ru Tsai

Kevin Dara Khieu

An intelligent speech assistant receives information collected while a user is speaking. The information can comprise speech data, vision data, or both, where the speech data is from the user speaking and the vision data is of the user while speaking. The assistant evaluates the speech data against a script which can contain information that the user should speak, information that the user should not speak, or both. The assistant collects instances where the user utters phrases that match the script or instances where the user utters phrases that do not match the script, depending on whether phases should or should not be spoken. The assistant evaluates vision data to identify gestures, facial expressions, and/or emotions of the user. Instances where the gestures, facial expressions, and/or emotions are not appropriate to the context are flagged. Real-time prompts and/or a summary is presented to the user as feedback.

Growing community of inventors

Vancouver, Canada

Huakai Liao