Amazon Technologies, Inc.

David Henry

Naveen Bobbili

John Ryan Sherritt

Jyoti Chhabra

Mark Vincent Mattione

Richard Du

Akshai Gopalakrishnan Prabhu

Philippe Andre Lantin

Alain Soquet

Yilin Zhu

Kenneth Chung Leung Chan

Ravi Chemudugunta

Techniques for routing data, in a system including multiple assistants, are described. A user device may store configuration data for a virtual assistant, where the configuration data includes a virtual assistant identifier, one or more resource identifiers, and optionally a virtual assistant name. A resource identifier may correspond to a component or device(s) of the virtual assistant. When the user device receives event data associated with a virtual assistant identifier, the user device may use stored configuration data to determine a resource identifier(s) associated with the virtual assistant identifier, associated with the event data. The user device may thereafter send the event data to the component and/or device(s) corresponding to the determined resource identifier(s).

Data routing in a multi-assistant context

A speech-processing system may provide access to one or more virtual assistants via an audio-controlled device. A multi-agent component of a device may be used to coordinate control of device process(es) regardless of the invoked agent and without necessarily sharing information between agents and corresponding speech-processing system(s). Device-state information may be sent from the multi-agent component to a speech-processing system to interpret a user command. If the command relates to a device process control it may be routed to a device skill and to the multi-agent component of the device. The multi-agent component may track a device state and may inform a particular speech-processing system if a process related to the particular speech-processing system has been controlled.

Multi-assistant device control

A speech-processing system may provide access to multiple virtual assistants via one or more voice-controlled devices. Each assistant may leverage language processing and language generation features of the speech-processing system, while handling different commands and/or providing access to different back applications. Each assistant may be associated with its own voice and/or speech style, and thus be perceived as having a particular 'personality.' Different assistants may be available for use with a particular voice-controlled device based on time, location, the particular user, etc. In some situations, language processing may be improved by leveraging data such as intent data, grammars, lexicons, entities, etc., associated with assistants available for use with the particular voice-controlled device.

Access to multiple virtual assistants

A speech-processing system may provide access to one or more virtual assistants via a voice-controlled device. The system may be activated by detecting a wakeword in speech received by a microphone of the device. The system may process the speech and provide a response in the form of synthetic speech. When a speaker of the device synthetic emits the speech, the microphone may detect some or all of the speech. If the synthetic speech includes a wakeword or words or phrases similar to the wakeword, a wakeword detection component of the device may detect the wakeword and activate an assistant, resulting in a self-wake or cross-wake. Self- or cross-wake may interrupt an action or response currently in progress, which may frustrate the user and result in a poor user experience. This disclosure thus proposes systems and methods for preventing cross-wake and self-wake in a voice-controlled device.

Preventing inadvertent wake in a speech-controlled device

A speech-processing system may provide access to multiple virtual assistants via one or more voice-controlled devices. Each assistant may leverage language processing and language generation features of the speech-processing system, while handling different commands and/or providing access to different back applications. Each assistant may be associated with its own voice and/or speech style, and thus be perceived as having a particular 'personality.' In some situations, a user may invoke a first assistant, e.g., with a wakeword or button press, and provide a command that the speech-processing system may determine will be better handled by a second assistant. The speech-processing system may thus call on a component to generate plan data describing one or more operations for the speech-processing system to execute to handoff the command to the second assistant and provide the user with indications of which assistant will handle the command.

Growing community of inventors

New York, NY, United States of America

David Henry