Amazon Technologies, Inc.

Michal Kowalczuk

Maciej Makowski

Fabian Andreas Bumberger

Bruno Dufour

Maciej Grabon

Ashwin Venkatesh Raman

Sasi Kiran Vepanjeri Lokanadha Reddy

Ariya Rastrow

Eli Joshua Fidler

Stanislaw Ignacy Pasko

Andrew Oberlin

Cagdas Bak

Pawel Zelazko

A speech interface device is configured to switch between languages, at the request of a user, in order to locally process utterances spoken in different languages, even in instances when a remote system is unavailable to, slower than, or otherwise less preferred than the speech interface device. For example, a user can request to set the language setting of the speech interface device to a second language, different from a first language to which the language setting of the device is currently set. Based on this user request, a local speech processing component of the device may load a language model(s) associated with the second language. The speech interface can also output voice prompts in the second language to manage the user's experience while a language update is in progress on the speech interface device.

Language switching on a speech interface device

Some speech processing systems may handle some commands on-device rather than sending the audio data to a second device or system for processing. The first device may have limited speech processing capabilities sufficient for handling common language and/or commands, while the second device (e.g., an edge device and/or a remote system) may call on additional language models, entity libraries, skill components, etc. to perform additional tasks. An intermediate data generator may facilitate dividing speech processing operations between devices by generating a stream of data that includes a first-pass ASR output (e.g., a word or sub-word lattice) and other characteristics of the audio data such as whisper detection, speaker identification, media signatures, etc. The second device can perform the additional processing using the data stream; e.g., without using the audio data. Thus, privacy may be enhanced by processing the audio data locally without sending it to other devices/systems.

Intermediate data for inter-device speech processing

Growing community of inventors

Gdansk, Poland

Michal Kowalczuk