Meta Platforms, Inc.

Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Joshua Warren Bingham

Jun Yang

Tyler Back

Michael Asfaw

Christopher Evans

Yuhuan Zeng

Jens Nilsson

Plamen Ivanov

Bo Zheng

Joshua Davies

Katherine Suzi Torigoe

Ulrik Skov

A method of detecting human voice activity includes determining a presence of human voice in a frame of audio signal using a plurality of features extracted from the frame of audio signal. The extracted features can include a number of zero-crossings, a periodicity metric, an energy ratio between a low frequency band and a high frequency band, and an envelope-to-floor ratio (EFR) in the frame of audio signal. Each of the features is associated with predefined criteria indicative of a presence of human voice, and based on comparisons of the features to the respective predefined criteria, the voice activity detector determines whether the frame of audio signal includes a human voice.

Voice activity detection in audio signal

An electronic device includes a microphone array to capture audio input data, a speaker array to render audio output data for playback; one or more sensors to detect an orientation of the microphone array, acoustic echo cancellation logic, and an interface. The acoustic echo cancellation logic applies acoustic echo cancellation to the audio input data to form echo-cancelled audio input data based on the orientation of the microphone array. The interface transmits the echo-cancelled audio input data over a communications channel as part of an audiovisual communication system.

Systems, devices, and methods of acoustic echo cancellation based on display orientation

An electronic device includes one or more microphones that generate audio signals and a wind noise detection subsystem. The electronic device may also include a wind noise reduction subsystem. The wind noise detection subsystem applies multiple wind noise detection techniques to the set of audio signals to generate corresponding indications of whether wind noise is present. The wind noise detection subsystem determines whether wind noise is present based on the indications generated by each detection technique and generates an overall indication of whether wind noise is present. The wind noise reduction subsystem applies one or more wind noise reduction techniques to the audio signal if wind noise is detected. The wind noise detection and reduction techniques may work in multiple domains (e.g., the time, spatial, and frequency domains).

Detection and removal of wind noise

An electronic device includes sensors configured to detect an orientation of a display, driver logic, and a speaker array. The driver logic processes the audio data received by an interface to form audio output data, and forms driver signals representing the audio output data based on the orientation of the display detected by the one or more sensors. The speaker array receives the driver signals formed orientation of the display, and renders the audio output data for playback based on the driver signals.

Systems, devices, and methods of manipulating audio data based on display orientation

An electronic device includes a microphone array configured to capture audio data, one or more sensors configured to detect an orientation of the microphone array, and digital signal processing (DSP) logic, and an interface. The DSP logic processes, based on the orientation of the microphone array detected by the one or more sensors, the audio data captured by the microphone array to form audio input data. The interface configured to transmit the audio input data over a communications channel to be output by another electronic device.

Systems, devices, and methods of manipulating audio data based on microphone orientation

A method of detecting voice activity includes performing a video analysis on a frame of video signal to determine a position of a user in the frame and to identify one or more beams of a corresponding audio signal associated with a region including the position of the user. The identified one or more beams of audio signal are analyzed to determine whether voice is present in the frame. When a user is not identified during the video analysis of the frame of video signal, audio analysis is not performed on the corresponding frame of audio signal.

Voice activity detection using audio and visual analysis

A display device may include (i) a display panel, (ii) a housing surrounding at least a portion of the display panel, (iii) an audio trench peripherally surrounding at least a portion of the display panel, the audio trench including a trench opening in a front side of the housing between a frame region and a peripheral region, and (iv) at least one speaker driver disposed between the display panel and a back side of the housing, the at least one speaker driver including a sound radiating surface positioned to direct sound waves into an acoustic chamber defined between the at least one speaker driver and the display panel, wherein a chamber opening is located between a lateral periphery of the acoustic chamber and the audio trench. Various other systems, devices, assemblies, and methods are also disclosed.

Growing community of inventors

Palo Alto, CA, United States of America

Joshua Warren Bingham