Joint audio interference reduction and frequency band compensation for videoconferencing

Abstract

One disclosed example method includes a device receiving an audio signal recorded in a physical environment and applying a machine learning model onto the audio signal to generate an enhanced audio signal. The machine learning model is configured to simultaneously remove interference and distortion from the audio signal and is trained via a training process. The training process includes generating a training dataset by generating a clean audio signal and generating a noisy distorted audio signal based on the clean audio signal that includes both an interference and a distortion. The training further includes constructing the machine learning model as a generative adversarial network (GAN) model that includes a generator model and multiple discriminator models, and training the machine learning model using the training dataset to minimize a loss function defined based on the clean audio signal and the noisy distorted audio signal.