System and method to use deep neural network to generate high-intelligibility binaural speech signals from single input

Abstract

A system and method of generating binaural signals includes receiving, by a processing device, a sound signal including speech and noise components, and transforming, by the processing device using a deep neural network (DNN), the sound signal into a first signal and a second signal. The transforming further includes encoding, by an encoding layer of the DNN, the sound signal into a sound signal representation in a latent space, rendering, by a rendering layer of the DNN, the sound signal representation into a first signal representation and a second signal representation in the latent space, and decoding, by a decoding layer of the DNN, the first signal representation into the first signal and the second signal representation into the second signal.