Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.v.

Adrian Murtaza

Achim Kuntz

Harald Fuchs

Jürgen Herre

Jan Plogsties

Christian Ertel

Fabian Küch

Christian Borss

Bernd Czelhan

Simone Neukam

Ingo Hofmann

Alexander Adami

Andreas Silzle

Andreas Hölzer

Matteo Agnelli

There are disclosed techniques, systems, methods and instructions for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree video environment. In one example, the system includes at least one media video decoder configured to decode video signals from video streams for the representation of VR, AR, MR or 360-degree video environment scenes to a user. The system includes at least one audio decoder configured to decode audio signals from at least one audio stream. The system is configured to request at least one audio stream and/or one audio element of an audio stream and/or one adaptation set to a server on the basis of at least the user's current viewport and/or head orientation and/or movement data and/or interaction metadata and/or virtual positional data.

Optimizing audio delivery for virtual reality applications

A method and a system for virtual reality, augmented reality, mixed reality, or 360-degree Video environment is disclosed. The system receives Video Streams associated to audio and video scenes to be reproduced and Audio Streams associated to audio and video scenes to be reproduced. There are provided a Video decoder which decodes signal from the Video Stream for the representation of the audio and video scene; an Audio decoder which decodes signal from the Audio Stream for the representation of the audio and video scene to the user; and a region of interest processor deciding, based e.g. on the user's viewport, head orientation, movement data, or metadata, whether an Audio information message is to be reproduced. At the decision, the reproduction of the Audio information message is caused.

Method and apparatus for efficient delivery and usage of audio messages for high quality of experience

Growing community of inventors

Erlangen, Germany

Adrian Murtaza