Location-aware neural audio processing in content generation systems and applications

Abstract

Approaches presented herein provide for identification of sound from a sound source relative to an array of microphones of a potentially unknown configuration using, in part, differences in the audio signals received by the microphones. In at least one embodiment, audio signals are captured using an array of microphones and audio features are extracted from those signals. The audio features can be processed using a first neural network to generate a feature vector representing a spatial location of an audio source with respect to the plurality of microphones, where the spatial location is inferred based on audio differences and independent of an availability of information indicating a physical configuration of the plurality of microphones. The feature vector can be provided to a task-specific model to perform at least one audio-related task based in part on the spatial location.