Apple Inc.

Microsoft Technology Licensing, LLC

Hassan Taherian

Jonathan J Huang

Carlos M Avendano

Xuedong D Huang

Zhuo Chen

Takuya Yoshioka

Huaming Wang

Sefik Emre Eskimez

Examples of array geometry agnostic multi-channel personalized speech enhancement (PSE) extract speaker embeddings, which represent acoustic characteristics of one or more target speakers, from target speaker enrollment data. Spatial features (e.g., inter-channel phase difference) are extracted from input audio captured by a microphone array. The input audio includes a mixture of speech data of the target speaker(s) and one or more interfering speaker(s). The input audio, the extracted speaker embeddings, and the extracted spatial features are provided to a trained geometry-agnostic PSE model. Output data is produced, which comprises estimated clean speech data of the target speaker(s) that has a reduction (or elimination) of speech data of the interfering speaker(s), without the trained PSE model requiring geometry information for the microphone array.

Array geometry agnostic multi-channel personalized speech enhancement

A method performed by an electronic device in a room. The method performs an enrollment process in which a spatial profile of a location of an artificial sound source is created and performs an identification process that determines whether a sound event within the room is produced by the artificial sound source by 1) capturing the sound event using a microphone array and 2) determining a likelihood that the sound event occurred at the location of the artificial sound source.

Method and system for detecting sound event liveness using a microphone array

Growing community of inventors

Columbus, OH, United States of America

Hassan Taherian