Nokia Technologies Oy

Nokia Corporation

Fischerwerke Gmbh & Co. Kg

Lasse Juhani Laaksonen

Arto Juhani Lehtiniemi

Miikka Tapani Vilermo

Mikko Tapio Tammi

Adriana Vasilache

Antti Johannes Eronen

Anssi Sakari Rämö

Sujeet Shyamsundar Mate

Anssi Ramo

Jussi Artturi Leppänen

Jussi Leppanen

Tapani Pihlajakuja

Mikko-Ville Laitinen

Kari Juhani Jarvinen

Juha Vilkamo

Jari Mathias Hagqvist

Kemal Ugur

Mikko-ville Laitinen

Mikko Olavi Heikkinen

Toni Makinen

Pushkar Prasad Patwardhan

Koray Ozcan

Henri Toukomaa

Olli Ali-Yrkko

Anssi Rämö

Francesco Cricri

Juha Matias Kallio

Kari Juhani Järvinen

Roope Olavi Jarvinen

Toni Mäkinen

Hannu Juhani Pulakka

Jussi Leppänen

Pasi Saari

Joonas Nikunen

Miika Tapani Vilermo

Kari Järvinen

Kalle Luukkanen

Example embodiments are disclosed relating to virtual content. Example embodiments may involve providing video data for output to a user device, the video data representing a virtual scene comprising one or more virtual objects at respective locations in the virtual scene with which a user of the user device may interact during an interactive session. The interactive session may be paused and a resumption input may be received at a second time, subsequent to the first time, for unpausing the interactive session. Responsive to receiving the resumption input, it may be detected that interaction with a particular virtual object, with which the user has interacted prior to the interactive session being paused, is restricted due to physical properties of a real-world space in which the user is located at the second time. The virtual scene may be modified to permit interaction with the particular virtual object without the detected restriction.

Virtual content

An apparatus, method and computer-program is described relating to user control in augmented reality (AR). For example, the method may comprise determining, based on motion of a user, one or more future step locations along a path. The method may also comprise displaying, via an augmented reality display device associated with the user, one or more interactive items. Each of the one or more interactive items may be associated with a respective one of the future step locations and is displayed so as to be perceived at a respective display position which is at or near said associated respective future step location. The method may also comprise detecting a control input associated with a particular interactive item, based at least in part on the user having reached a selection area which is at or near said associated future step location along the path.

User control in augmented reality

An apparatus including circuitry configured to: obtain at least one location and/or orientation associated with a user; obtain, based on the at least one location and/or orientation, one or more audio element, wherein the one or more audio element at least partially forms an audio scene; obtain, based on the at least one location and/or orientation, at least one auxiliary audio element, the at least one auxiliary audio element being at least one audio element or a combination of audio elements, wherein the at least one auxiliary audio element is associated with at least a part of the audio scene and is located at an outside zone of the audio scene; render the obtained audio element and/or at least one auxiliary audio element.

Associated spatial audio playback

An apparatus comprising means configured to:

Tactile audio display

An apparatus for rendering communication audio signal within an immersive audio scene, the apparatus including circuitry configured to: obtain at least one spatial audio signal for rendering within the immersive audio scene; obtain the communication audio signal and positional information associated with the communication audio signal; obtain a rendering processing parameter associated with the communication audio signal; determine a rendering method based on the rendering processing parameter; determine an insertion point in a rendering processing for the determined rendering method and/or a selection of rendering elements for the determined rendering method based on the rendering processing parameter.

Method and apparatus for communication audio handling in immersive audio scene rendering

An apparatus configured to: receive a spatial media file comprising a plurality of viewpoints; determine a viewpoint from the plurality of viewpoints for a user consuming the spatial media file; receive an audio stream associated with the viewpoint; receive an augmentation audio stream, wherein the augmentation audio stream is at least partially different from the audio stream; control an audio rendering of the audio stream based, at least partially, on metadata associated with the augmentation audio stream; and provide the audio rendering of the audio stream for mixing with a rendering of the augmentation audio stream.

Multi-viewpoint multi-user audio user experience

An apparatus configured to: obtain at least one signal, wherein the at least one signal comprises one or more transport audio signals; obtain an indicator specifying a type of the one or more transport audio signals; and process the one or more transport audio signals based, at least partially, on the indicator to generate one or more processed transport audio signals that are of an at least partially different type than the type of the one or more transport audio signals.

Spatial audio representation and rendering

An apparatus for generating a spatialized audio output based on a user position, the apparatus including circuitry configured to: obtain a user position value; obtain at least one input audio signal and associated metadata enabling a rendering of the at least one input audio signal; generate an intermediate format immersive audio signal based on the at least one input audio signal, the metadata, and the user position value; process the intermediate format immersive audio signal to obtain the at least one spatial parameter and the at least one audio signal; and encode the at least one spatial parameter and the at least one audio signal, wherein the at least one spatial parameter and the at least one audio signal are configured to at least in part generate the spatialized audio output.

Method and apparatus for efficient delivery of edge based rendering of 6DoF mpeg-i immersive audio

There is provided an apparatus comprising means for receiving spatial audio capture requirement(s) of one or more user devices; determining position and/or orientation information of the one or more user devices; generating one or more privacy masks at least partly based on the spatial audio capture requirement(s) and position and/or orientation information of the one or more user devices; and transmitting the generated privacy masks to the one or more user devices.

Privacy protection in spatial audio capture

An apparatus, method and computer program for signaling change events at an audio output device are disclosed. The apparatus may include circuitry for detecting, during an audio communications session between a first user device and a second user device, a change event at a first earphones device associated with the first user device, the first earphones device included of first and second earphones. The apparatus may also include circuitry for signaling the detected change event to the second user device and/or a second audio output device associated with the second user device.

Signalling change events at an audio output device

An apparatus configured to: obtain at least one spatial audio signal, the at least one spatial audio signal comprising at least one audio signal and at least one spatial parameter; determine at least one first audio signal based, at least partially, on the at least one spatial audio signal and the at least one of the user position or orientation; obtain at least one augmentation audio signal, wherein the at least one augmentation audio signal has a different audio format than an audio format of the at least one spatial audio signal, wherein the at least one augmentation audio signal provides a different type of media content; determine at least one second audio signal based, at least partially, on at least a part of the at least one augmentation audio signal; and mix the at least one first audio signal and the at least one second audio signal.

Spatial audio augmentation

An apparatus, method and computer program is described including: detecting a tracking tag in proximity of a user device (the tracking tag not being pre-associated with the user device); responsive to the detection (and while the tracking tag remains in proximity of the user device): identifying one or more contextual parameters associated with the tracking tag; and responsive to determining that the identified one or more contextual parameters meet a predetermined criterion or criteria, issuing or causing issuance of an alert to the user device and/or to the tracking tag.

Tracking tags

There is inter alia disclosed an apparatus for spatial audio encoding comprising: means for determining a first spatial audio parameter of a frequency sub band of one or more audio signals and a second spatial audio parameter of the frequency sub band of the one or more audio signals; and means for combining the first spatial audio parameter and the second spatial audio parameter to provide a combined spatial audio parameter for the frequency sub band.

Combining of spatial audio parameters

An apparatus including circuitry configured to: enable a conversational service between a first user of the apparatus and a second user of a remote apparatus wherein the conversational service is a duplex service including simultaneous voice communication from the first user to the second user and voice communication from the second user to the first user; and enable synchronization of a switch to using an active noise cancellation mode at the apparatus for the conversational service and at the remote apparatus for the conversational service, wherein the switch to using the noise cancellation mode is synchronized between the first and second users.

Conversational service

There is inter alia disclosed an apparatus for spatial audio encoding comprising: means for determining at least two of a type of spatial audio parameter for one or more audio signals, wherein a first of the type of spatial audio parameter is associated with a first group of samples in a domain of the one or more audio signals and a second of the type of spatial audio parameter is associated with a second group of samples in the domain of the one or more audio signals; and means for merging the first of the type of spatial audio parameter and the second of the type of spatial audio parameter into a merged spatial audio parameter.

Growing community of inventors

Nokia, Finland

Lasse Juhani Laaksonen