Sonos, Inc.

Saeed Bagheri Sereshki

Daniele Giacobello

Romi Kadri

Aaron Jones

Jerad M Lewis

Adib Mehrabi

Systems and methods for mapping noise via a plurality of playback devices within an environment are disclosed herein. In one example, a plurality of playback devices can each output audio and also detect sound within the environment to obtain respective sound data specimens. For each playback device, the respective sound data specimen can be analyzed to obtain a respective noise determination. A spatial map of the noise determinations within the environment can then be constructed. A visual representation of the spatial map can further be presented to a user. In response to the noise determinations and/or a user input, the audio output via at least one of the playback devices can be modified, for example to mask or suppress noise within one or more regions of the environment.

Mapping and characterizing acoustic events within an environment via audio playback devices

A playback device is configured to: produce a first channel audio output of a first channel of audio content; produce a second channel audio output of a second channel of the audio content; receive captured audio content comprising (i) a first portion corresponding to the first channel audio output, (ii) a second portion corresponding to the second channel audio output, and (iii) a third portion corresponding to a voice command, wherein the captured audio content has a first signal-to-noise ratio; determine a set of signal components from at least one of the first channel or the second channel of the audio content; perform acoustic echo cancellation on a subset of signal components; determine an acoustic echo cancellation output; and apply the acoustic echo cancellation output to the captured audio content and thereby increase the first signal-to-noise ratio to a second signal-to-noise ratio that is greater than the first signal-to-noise ratio.

Multi-channel acoustic echo cancellation

Example techniques involve systems with multiple acoustic echo cancellers. An example implementation captures first audio within an acoustic environment and detecting, within the captured first audio content, a wake-word. In response to the wake-word and before playing an acknowledgement tone, the implementation activates (a) a first sound canceller when one or more speakers are playing back audio content or (b) a second sound canceller when the one or more speakers are idle. In response to the wake-word and after activating either (a) the first sound canceller or (b) the second sound canceller, the implementation outputs the acknowledgement tone via the one or more speakers. The implementation captures second audio within the acoustic environment and cancelling the acoustic echo of the acknowledgement tone from the captured second audio using the activated sound canceller.

Tone and echo cancellation using two acoustic sound cancellers

Systems and methods for suppressing noise and detecting voice input in a multi-channel audio signal captured by two or more network microphone devices include receiving an instruction to process one or more audio signals captured by a first network microphone device and after receiving the instruction (i) disabling at least a first microphone of a plurality of microphones of a second network microphone device, (ii) capturing a first audio signal via a second microphone of the plurality of microphones, (iii) receiving over a network interface of the second network microphone device a second audio signal captured via at least a third microphone of the first network microphone device, (iv) using estimated noise content to suppress first and second noise content in the first and second audio signals, (v) combining the suppressed first and second audio signals into a third audio signal, and (vi) determining that the third audio signal includes a voice input comprising a wake word.

Linear filtering for noise-suppressed speech detection via multiple network microphone devices

Echo of tone interferance cancellation using two acoustic echo cancellers

Systems and methods for audio processing include capturing first sound data via at least one microphone of a network microphone device (NMD) and determining, via a voice activity detection process, that the first sound data does not include voice activity. The first sound data is stored in a buffer, and the NMD forgoes spatial processing of the first sound data. The NMD can capture second sound data and determine, via the voice activity process, that the second sound data includes voice activity. The NMD spatially processes the sound data to produce filtered sound data. The NMD detects a wake word based on data in the buffer. After detecting the wake word, the NMD may determine an action to be performed based on the data in the buffer.

Systems and methods for power-efficient keyword detection

Systems and methods for suppressing noise and detecting voice input in a multi-channel audio signal captured by a plurality of microphones include (i) capturing a first audio signal via a first microphone and a second audio signal via a second microphone, wherein the first and second audio signals respectively comprises first and second noise content from a noise source; (ii) identifying the first noise content in the first audio signal; (iii) using the identified first noise content to determine an estimated noise content captured by the plurality of microphones; (iv) using the estimated noise content to suppress the first and second noise content in the first and second audio signals; (v) combining the suppressed first and second audio signals into a third audio signal; and (vi) determining that the third audio signal includes a voice input comprising a wake word.

Linear filtering for noise-suppressed speech detection

Systems and methods for audio processing include capturing sound data via at least one microphone of a network microphone device (NMD) and determining whether the captured sound includes voice activity. While in a first stage, the NMD forgoes spatial processing of the captured sound data. If the NMD determines that the detected sound includes voice activity, the NMD transitions to a second stage. In this second stage, the NMD spatially processes the detected sound to produce filtered sound data and detects a wake word. After detecting the wake word, the NMD may determine an action to be performed based on the captured sound data.

A playback device is configured to receive, via a network interface, a source stream of audio including first and second channel streams of audio, and to produce, via respective first and second speaker drivers, a first channel audio output and a second channel audio output. The playback device is also configured to receive, via one or more microphones, a captured stream of audio including first and second portions corresponding to the respective first and second channel audio outputs. The playback device is also configured to combine at least the first channel stream of audio and the second channel stream of audio into a compound audio signal and perform acoustic echo cancellation on the compound audio signal and thereby produce an acoustic echo cancellation output, then to apply the acoustic echo cancellation output to the captured stream of audio and thereby increase a signal-to noise ratio of the captured stream of audio.

Growing community of inventors

Goleta, CA, United States of America

Saeed Bagheri Sereshki