Amazon Technologies, Inc.

Vincent Auvray

Nikko Strom

Angeliki Metallinou

Ariya Rastrow

Arindam Mandal

Siddhartha Reddy Jonnalagadda

Prakash Krishnan

Aaron Challenner

Minmin Shen

Rohit Prasad

Shiv Naga Prasad Vitaladevuni

Ying Shi

Anushree Venkatesh

Veerdhawal Pande

Alexandros Potamianos

Arijit Biswas

Thomas Edward Taylor

David Chi-Wai Tang

Josey Diego Sandoval

Nishtha Gupta

Bonan Zheng

Amotz Maimon

Yohan Jo

David A Jara

Xinyan Zhao

Nikolaos Malandrakis

Jiahui Li

Techniques for determining when speech is directed at another individual of a dialog, and storing a representation of such user-directed speech for use as context when processing subsequently-received system-directed speech are described. A system receives audio data and/or video data and determines therefrom that speech in the audio data is user-directed. Based on this, the system determine whether the speech is able to be used to perform an action by the system. If the speech is able to be used to perform an action, the system stores a natural language representation of the speech. Thereafter, when the system receives system-directed speech, the system generates a rewrite of a natural language representation of the system-directed speech based on the previously-received user-directed speech. The system then determines output data responsive to the system-directed speech using the rewritten natural language representation.

Natural language generation

A natural language system may be configured to act as a participant in a conversation between two users. The system may determine when a user expression such as speech, a gesture, or the like is directed from one user to the other. The system may processing input data related the expression (such as audio data, input data, language processing result data, conversation context data, etc.) to determine if the system should interject a response to the user-to-user expression. If so, the system may process the input data to determine a response and output it. The system may track that response as part of the data related to the ongoing conversation.

Dialog management for multiple users

A system that is capable of resolving anaphora using timing data received by a local device. A local device outputs audio representing a list of entries. The audio may represent synthesized speech of the list of entries. A user can interrupt the device to select an entry in the list, such as by saying 'that one.' The local device can determine an offset time representing the time between when audio playback began and when the user interrupted. The local device sends the offset time and audio data representing the utterance to a speech processing system which can then use the offset time and stored data to identify which entry on the list was most recently output by the local device when the user interrupted. The system can then resolve anaphora to match that entry and can perform additional processing based on the referred to item.

Growing community of inventors

Scotts Valley, CA, United States of America

Vincent Auvray