Apparatus and method for generating an audio signal

Abstract

An apparatus comprises a first receiver () receives a real time image sequence of depth and/or visual data from an image sensor. A second receiver () receives a set of audio objects and metadata indicative of links between audio objects and material characteristics. An image generator () generates an output image sequence comprising an image object corresponding to a virtual scene object in the real world scene and a detector () detects an interaction between the virtual scene object and a real world scene object of a real world scene. An estimator () determines a material property for the real world scene object in response to image data of the sequence of image frames and a selector () selects an audio object in response to the material property and material characteristics linked to the set of audio objects. An output circuit () generates the output audio signal comprising the first audio object.