Amazon Technologies, Inc.

Fabian Andreas Bumberger

Maciej Makowski

Eli Joshua Fidler

Maciej Grabon

Bruno Dufour

Benjamin Charles Eagan

Ashwin Venkatesh Raman

Michal Kowalczuk

Sasitheran Shanmugarajah

Sabria Farheen

Sasi Kiran Vepanjeri Lokanadha Reddy

John Russell Lepird

Ashutosh Thakur

Zach Mathew

Alejandro Jose Ramirez Sanabria

Muhammad Zain Mustafa

Ieliena Cannata

A speech processing system that enables voice-privacy mode operations for resource limited computing devices. A device that has limited speech processing capabilities/is otherwise resource limited, connects to a local host. The user may then enable a voice-privacy mode for the limited device. When the mode is active, if the limited device detects an utterance, it sends the audio data of the utterance to the local host, which performs limited speech processing and sends the resulting data back to the limited device, which then sends it to a more powerful device to complete the speech processing.

Privacy mode for multi-device processing

A speech interface device is configured to switch between languages, at the request of a user, in order to locally process utterances spoken in different languages, even in instances when a remote system is unavailable to, slower than, or otherwise less preferred than the speech interface device. For example, a user can request to set the language setting of the speech interface device to a second language, different from a first language to which the language setting of the device is currently set. Based on this user request, a local speech processing component of the device may load a language model(s) associated with the second language. The speech interface can also output voice prompts in the second language to manage the user's experience while a language update is in progress on the speech interface device.

Language switching on a speech interface device

This disclosure proposes systems and methods enabling on-device/hybrid processing of speech requests using a hub device. The hub device is capable of receiving audio data from surrounding devices and performing speech processing on the audio data to improve latency and/or provide functionality to other devices within a private network. The hub device may receive multiple requests corresponding to different utterances. If the hub device receives a second utterance while processing a first utterance, the hub device may send an error notification, process the first utterance and the second utterance sequentially, suspend processing of the first utterance to process the second utterance first, send the second utterance to another hub device or remote system, or suspend processing of the first utterance and send the first utterance to the remote system in order to process the second utterance.

Speech processing for multiple inputs

A speech interface device is configured to update personalized data in local memory for responding to user speech. The speech interface device may receive compiled personalized data from a remote system, or raw personalized data from local devices in the environment of the speech interface device, the raw personalized data being compiled locally on the speech interface device. The compiled personalized data is received by an artifact manager of the speech interface device for storage in the memory of the speech interface device. A local speech processing component of the speech interface device may use the compiled personalized data when processing user speech in order to understand a spoken form of a word or phrase that is associated with a user. This allows for responding to personal user speech, even when the speech interface device is unable to communicate with a remote speech processing system over a wide area network.

Updating personalized data on a speech interface device

Techniques for performing spoken language understanding (SLU) processing locally on a user device are described. When a user device is about to present content on a display, the user device may generate one or more SLU models (e.g., one or more ASR models and/or one or more NLU models) specific to the content to be presented. When the user device receives a spoken input while the content is being presented on the display, the user device performs SLU processing on the spoken input using the display-specific SLU model(s).

On-device contextual understanding

Growing community of inventors

Toronto, Canada

Fabian Andreas Bumberger