Fraunhofer-gesellschaft Zur Foerderung Der Angewandten Forschung E.v.

Koninklijke Philips Corporation N.V.

Dolby Sweden Ag

Dolby International Ab

Jan Plogsties

Johannes Hilpert

Achim Kuntz

Andreas Hoelzer

Harald Fuchs

Juergen Herre

Christian Ertel

Sascha Dick

Michael Kratschmer

Bernhard Neugebauer

Adrian Murtaza

Bernd Czelhan

Stefan Doehla

Julien Robilliard

Stephan Schreiner

Juha Vilkamo

Harald Mundt

Bernhard Grill

Max Neuendorf

Harald Popp

Fabian Kuech

Christian Borss

Sascha Disch

Oliver Hellmuth

Ingo Hofmann

Lars Villemoes

Jonas Engdegard

Jürgen Herre

Jeroen Koppens

Emanuel Habets

Fabian Küch

Karsten Linzmeier

Stefan Döhla

Simone Neukam

Simone Fueg

Andreas Silzle

Alexander Adami

Hanne Stenzel

Felix Fleischmann

Florian Leschka

Matteo Agnelli

Aleksandr Karapetyan

Simone Fug

Cornelia Falch

Wolfgang Hess

Jeroen Dirk Breebaart

Leonid Terentiev

Felix Wolf

Stefan Varga

Andreas Hölzer

Andreas Holzer

Jeroen Breebaart

Simone FÜG

Bernhard Neuebauer

There are disclosed techniques, systems, methods and instructions for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree video environment. In one example, the system includes at least one media video decoder configured to decode video signals from video streams for the representation of VR, AR, MR or 360-degree video environment scenes to a user. The system includes at least one audio decoder configured to decode audio signals from at least one audio stream. The system is configured to request at least one audio stream and/or one audio element of an audio stream and/or one adaptation set to a server on the basis of at least the user's current viewport and/or head orientation and/or movement data and/or interaction metadata and/or virtual positional data.

Optimizing audio delivery for virtual reality applications

Audio data processor, having: a receiver interface for receiving encoded audio data and metadata related to the encoded audio data; a metadata parser for parsing the metadata to determine an audio data manipulation possibility; an interaction interface for receiving an interaction input and for generating, from the interaction input, interaction control data related to the audio data manipulation possibility; and a data stream generator for obtaining the interaction control data and the encoded audio data and the metadata and for generating an output data stream, the output data stream having the encoded audio data, at least a portion of the metadata, and the interaction control data.

Data processor and transport of user control data to audio decoders and renderers

An apparatus for generating loudspeaker signals includes an object metadata processor configured to receive metadata, to calculate a second position of the audio object depending on the first position of the audio object and on a size of a screen if the audio object is indicated in the metadata as being screen-related, to feed the first position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being not screen-related, and to feed the second position of the audio object as the position information into the object renderer if the audio object is indicated in the metadata as being screen-related. The apparatus further includes an object renderer configured to receive an audio object and to generate the loudspeaker signals depending on the audio object and on position information.

Apparatus and method for screen related audio object remapping

A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.

Method and apparatus for efficient delivery and usage of audio messages for high quality of experience

A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is separately processed with an early part and a late reverberation of the room impulse response, and the processed early part of the audio signal and the reverberated signal are combined. A transition from the early part to the late reverberation in the room impulse response is reached when a correlation measure reaches a threshold, the threshold being set dependent on the correlation measure for a selected one of the early reflections in the early part of the room impulse response.

Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer

A method for processing an audio signal in accordance with a room impulse response is described. The audio signal is processed with an early part of the room impulse response separate from a late reverberation of the room impulse response, wherein the processing of the late reverberation has generating a scaled reverberated signal, the scaling being dependent on the audio signal. The processed early part of the audio signal and the scaled reverberated signal are combined.

Method for processing an audio signal, signal processing unit, binaural renderer, audio encoder and audio decoder

An apparatus for playing back an audio object associated with a position includes a distance calculator for calculating distances of the position to speakers or for reading the distances of the position to the speakers. The distance calculator is configured to take a solution with a smallest distance. The apparatus is configured to play back the audio object using the speaker corresponding to the solution.

Apparatus and method for audio rendering employing a geometric distance definition

Audio encoder for encoding audio input data to obtain audio output data includes an input interface for receiving a plurality of audio channels, a plurality of audio objects and metadata related to one or more of the plurality of audio objects; a mixer for mixing the plurality of objects and the plurality of channels to obtain a plurality of pre-mixed channels, each pre-mixed channel including audio data of a channel and audio data of at least one object; a core encoder for core encoding core encoder input data; and a metadata compressor for compressing the metadata related to the one or more of the plurality of audio objects, wherein the audio encoder is configured to operate in at least one mode of the group of two modes.

Concept for audio encoding and decoding for audio channels and audio objects

An audio decoder device for decoding a compressed input audio signal having at least one core decoder having one or more processors for generating a processor output signal based on a processor input signal, wherein a number of output channels of the processor output signal is higher than a number of input channels of the processor input signal, wherein each of the one or more processors has a decorrelator and a mixer, wherein a core decoder output signal having a plurality of channels has the processor output signal, and wherein the core decoder output signal is suitable for a reference loudspeaker setup; at least one format converter device configured to convert the core decoder output signal into an output audio signal, which is suitable for a target loudspeaker setup; and a control device configured to control at least one or more processors in such way that the decorrelator of the processor may be controlled independently from the mixer of the processor, wherein the control device is configured to control at least one of the decorrelators of the one or more processors depending on the target loudspeaker setup.

Renderer controlled spatial upmix

Growing community of inventors

Fuerth, Germany

Jan Plogsties