Koninklijke Philips Corporation N.v.

Jeroen Gerardus Henricus Koppens

Arnoldus Werner Johannes Oomen

Erik Gosuinus Petrus Schuijers

Nathan Souviraa-Labastie

Christiaan Varekamp

Bart Kroon

Leon Maria Van De Kerkhof

Patrick Kechichian

Dirk Jeroen Breebaart

Werner Paulus Josephus De Bruijn

Paulus Henricus Antonius Dillen, I

Sam Martin Jelfs

Franciscus Marinus Jozephus De Bont

Nathan SouviraÀ-Labastie

An acoustic image source model for early reflections in a room is generated by iteratively mirroring () rooms around boundaries (e.g. walls) of rooms of the previous iteration. Determination of mirror positions in the image rooms for an audio source in the original room is performed by determining () matching reference positions in the two rooms and a relative mapping of directions between the two rooms (). A mirror position in the mirror room from an audio source in the original room is determined () by mapping relative offsets between the positions of the audio source and the reference positions. The approach may provide a computationally very efficient approach.

Determining virtual audio source positions

An audio encoding apparatus comprises an audio receiver () receiving audio items representing an audio scene and a metadata receiver () receives input presentation metadata for the audio items describing presentation constraints for the rendering of the audio items. The presentation constraints constrain a rendering parameter that can be adapted when rendering the audio items. An audio encoder () generates encoded audio data for the audio scene by encoding the plurality of audio items with the encoding being adapted in response to the input presentation metadata. A metadata circuit () generates output presentation metadata from the input presentation metadata. The output presentation metadata comprises data for encoded audio items which constrain the extent by which an adaptable parameter of a rendering can be adapted when rendering the encoded audio items. An output () generates an encoded audio data stream comprising the encoded audio data and the output presentation metadata.

Apparatus and method for audio encoding

An audio apparatus for generating a flutter echo audio signal comprises a receiver () arranged to receive room metadata indicative of properties of a room. The room metadata may e.g. indicate dimensions of the room and/or acoustic reflection data for boundaries of the room. An estimator () determines a flutter echo estimate for the room in response to the room metadata where the flutter echo estimate is indicative of a level of a flutter echo in the room. A signal generator () includes a feedback delay network comprising a plurality of feedback loops. The signal generator () is arranged to generate the flutter echo audio signal from output signals of a set of feedback loops of the plurality of feedback loops being fed an audio source signal. An adapter () adapts a first parameter for a first feedback loop of the set of feedback loops in response to the flutter echo estimate.

Audio apparatus and method therefor

An audio apparatus, e.g. for rendering audio for a virtual/augmented reality application, comprises a receiver () for receiving audio data for an audio scene including a first audio component representing a real-world audio source present in an audio environment of a user. A determinator () determines a first property of a real-world audio component from the real-world audio source and a target processor () determines a target property for a combined audio component being a combination of the real-world audio component received by the user and rendered audio of the first audio component received by the user. An adjuster () determines a render property by modifying a property of the first audio component indicated by the audio data for the first audio component in response to the target property and the first property. A renderer () renders the first audio component in response to the render property.

Audio apparatus and method of operation therefor

An audio apparatus for generating a diffuse reverberation signal comprises a receiver () receiving audio signals representing sound sources and metadata comprising a diffuse reverberation signal to total source relationship indicative of a level of diffuse reverberation sound relative to total emitted sound in the environment. The metadata also for each audio signal comprises a signal level indication and a directivity data indicative of directivity of sound radiation from the sound source represented by the audio signal. A circuit () determines a total emitted energy indication based on the signal level indication and the directivity data, and a downmix coefficient based on the total emitted energy and the diffuse reverberation signal to total signal relationship. A downmixer () generates a downmix signal by combining signal components for each audio signal generated by applying the downmix coefficient for each audio signal to the audio signal. A reverberator () generates the diffuse reverberation signal for the environment from the downmix signal component.

Apparatus and method for generating a diffuse reverberation signal

A distribution system comprises an audio server () for receiving incoming audio from remote clients () and for transmitting audio derived from the incoming audio to the remote clients (). An audio apparatus comprises an audio a receiver () which receives data comprising: audio data for a plurality of audio components representing audio from a remote client of the plurality of remote clients; and proximity data for at least one of the audio components. The proximity data is indicative of proximity between remote clients. A generator () of the apparatus generates an audio mix from the audio components in response to the proximity data. For example, an audio component indicated to be proximal to a remote client may be excluded from an audio mix for that remote client.

Audio apparatus, audio distribution system and method of operation therefor

An acoustic image source model for early reflections in a room is generated by iteratively mirroring () rooms around boundaries (e.g. walls) of rooms of the previous iteration. The boundaries around which to mirror in each iteration is determined () by a specific selection criterion including requiring that mirror directions cannot be reversed, cannot be in an excluded direction and cannot be repeated unless in a continuous series of mirrorings.

Apparatus and method for determining virtual sound sources

A first audio apparatus generates a data signal comprising data for an audio scene, the data comprising input audio source data for at least a first audio source and acoustic object data for at least one acoustic object in the audio scene, the acoustic object data comprising acoustic coupling data and spatial property data for the acoustic object. A second audio apparatus comprises a receiver () for receiving the signal. A generator () generates object audio source data for an object audio source representing audio emitted in the audio scene by the acoustic object from coupling of audio from the first audio source. The generator () is arranged to generate the object audio source data in response to the acoustic coupling data, the spatial property data, and the input audio source data. A renderer () renders the audio scene, the rendering including rendering the object audio source data.

An apparatus for processing audiovisual data for a scene comprises a receiver () for receiving audiovisual data for the scene. The audiovisual data comprises audio data for the scene comprising a plurality of audio elements and image data for at least a first image of the scene where the first image has a first aspect ratio. An image remapper () performs a content dependent non-uniform mapping of the first image to a second image which has a different aspect ratio. The image remapper () is arranged to generate mapping data describing the content dependent non-uniform mapping. An audio remapper () replaces a first audio element of the plurality of audio elements by a second audio element generated by modifying a spatial property for the first audio element in response to the mapping data. The spatial property being modified may be a position and/or spatial spread of the first audio element.

Apparatus and method for processing audiovisual data

An audio apparatus, e.g. for rendering audio for a virtual/augmented reality application, comprises a receiver () for receiving audio data for an audio scene including a first audio component representing a real-world audio source present in an audio environment of a user. A determinator () determines a first property of a real-world audio component from the real-world audio source and a target processor () determines a target property for a combined audio component being a combination of the real-world audio component received by the user and rendered audio of the first audio component received by the user. An adjuster determines a render property by modifying a property of the first audio component indicated by the audio data for the first audio component in response to the target property and the first property. A renderer () renders the first audio component in response to the render property.

A transmitting device comprises a binaural circuit () which provides a plurality of binaural rendering data sets, each binaural rendering data set comprising data representing parameters for a virtual position binaural rendering. Specifically, head related binaural transfer function data may be included in the data sets. A representation circuit () provides a representation indication for each of the data sets. The representation indication for a data set is indicative of the representation used by the data set. An output circuit () generates a bitstream comprising the data sets and the representation indications. The bitstream is received by a receiver () in a receiving device. A selector () selects a selected binaural rendering data set based on the representation indications and a capability of the apparatus, and an audio processor () processes the audio signal in response to data of the selected binaural rendering data set.

Binaural audio processing

An audio renderer comprises a receiver () receiving input data comprising early part data indicative of an early part of a head related binaural transfer function; reverberation data indicative of a reverberation part of the transfer function; and a synchronization indication indicative of a time offset between the early part and the reverberation part. An early part circuit () generates an audio component by applying a binaural processing to an audio signal where the processing depends on the early part data. A reverberator () generates a second audio component by applying a reverberation processing to the audio signal where the reverberation processing depends on the reverberation data. A combiner () generates a signal of a binaural stereo signal by combining the two audio components. The relative timing of the audio components is adjusted based on the synchronization indication by a synchronizer () which specifically may be a delay.

Growing community of inventors

Nederweert, Netherlands

Jeroen Gerardus Henricus Koppens