Amazon Technologies, Inc.

Other

Marcin Fuszara

Stanislaw Ignacy Pasko

Maciej Makowski

Michal Papierski

Aliaksei Kuzmin

Mariusz Rozycki

A speech interface device is configured with 'hybrid' capabilities, which allows the speech interface device to perform actions in response to user speech, even when the speech interface device is unable to communicate with a remote system over a wide area network (e.g., the Internet). A hybrid request selector of the speech interface device sends audio data representing user speech to both a remote speech processing system and a local speech processing component executing on the speech interface device, and then waits for a response from either or both components. The local speech processing component may start execution based on the audio data and subsequently suspend the execution until further instruction from the hybrid request selector. The hybrid request selector can then determine which response to use, and, depending on which response is chosen, may instruct the local speech processing component to either continue or terminate the suspended execution.

Hybrid speech interface device

A speech interface device is configured to process user speech by storing, in volatile memory of the speech interface device, audio data that represents user speech, and inputting first audio data, of the stored audio data, to an automatic speech recognition (ASR) component of the speech interface device, determining that a criterion is satisfied, and, based on the criterion being satisfied, maintaining second audio data in the volatile memory. The ASR component may generate text data based on the first audio data, a natural language understanding (NLU) component of the speech interface device may generate NLU data based on the text data, and, if the NLU data corresponds to a recognized intent, the second audio data may be deleted. Otherwise, speech processing can be resumed by inputting the second audio data to the ASR component.

Pausing automatic speech recognition

Growing community of inventors

Gdansk, Poland

Marcin Fuszara