Nokia Technologies Oy

Nokia Corporation

Nokia Mobile Phones Limited

Fischerwerke Gmbh & Co. Kg

Wsou Investments, LLC

Mikko Tapio Tammi

Miikka Tapani Vilermo

Lasse Juhani Laaksonen

Arto Juhani Lehtiniemi

Adriana Vasilache

Anssi Sakari Rämö

Jussi Virolainen

Mikko-Ville Laitinen

Anssi Ramo

Kemal Ugur

Juha Vilkamo

Ravi Shenoy

Sampo Vesa

Toni Mäkinen

Toni Makinen

Erika Reponen

Jorma Mäkinen

Milan Jelinek

Matti Sakari Hamalainen

Anu Huttunen

Jorma Makinen

Claude LaFlamme

Vesa Ruoppila

Antti Johannes Eronen

Sujeet Shyamsundar Mate

Jussi Leppanen

Francesco Cricri

Jani Kristian Nurminen

Ville-Veikko Mattila

Jussi Severi Uusitalo

Jarmo Antero Hiipakka

Mikko-ville Laitinen

Mikko Olavi Heikkinen

Ari Heikkinen

Antti Pekka Kelloniemi

Topi Kaaresoja

Tuomas Virtanen

Joonas Nikunen

Kimmo Makitalo

Ossi E Maenpaa

Pasi Pertila

Miikka Vilermo

An apparatus including circuitry configured to: obtain two or more audio signals from respective two or more microphones; determine, in one or more frequency band of the two or more audio signals, a first sound source direction parameter based on processing of the two or more audio signals, wherein processing of the two or more audio signals is further configured to provide one or more modified audio signal based on the two or more audio signals; and determine, in the one or more frequency band of the two or more audio signals, at least a second sound source direction parameter at least based on at least in part the one or more modified audio signal.

Spatial audio capture

A method for audio focusing is provided, the method comprising: receiving a multi-channel audio signal that represents sounds in sound directions that correspond to respective positions in an image area of an image; receiving an indication of an audio focus direction that corresponds to a first position in the image area; selecting a primary sound direction from a plurality of different available candidate directions, wherein said plurality of different available candidate directions comprise said audio focus direction and one or more offset candidate directions and wherein each offset candidate direction corresponds to a respective candidate offset from said first position in the image area; and deriving, based on said multi-channel audio signal in dependence of the selected primary sound direction, an output audio signal.

Audio processing of multi-channel audio signals

A method, apparatus and computer program, the method comprising: receiving a plurality of input signals representing a sound space; using the received plurality of input signals to obtain spatial metadata corresponding to the sound space; using the received plurality of input signals to obtain a first spatial audio signal corresponding to the spatial metadata; and associating the first spatial audio signal with the spatial metadata to enable the spatial metadata to be used to process the first spatial audio signal to obtain a second spatial audio signal.

Recording and rendering audio signals

An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor configured to: define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; and define with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associated with the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being applied in audio rendering of both the at least two of the plurality of audio objects and the at least one further audio object.

Grouping and transport of audio objects

According to an example embodiment, a method for processing a multi-channel input audio signal representing a sound field into a multi-channel output audio signal representing said sound field in accordance with a predefined loudspeaker layout is provided, the method comprising the following for at least one frequency band: obtaining spatial audio parameters that are descriptive of spatial characteristics of said sound field; estimating a signal energy of the sound field represented by the multi-channel input audio signal; estimating, based on said signal energy and the obtained spatial audio parameters, respective output signal energies for channels of the multi-channel output audio signal according to said predefined loudspeaker layout; determining a maximum output energy as the largest of the output signal energies across channels of said multi-channel output audio signal; and deriving, on basis of said maximum output energy, a gain value for adjusting sound reproduction gain in at least one of said channels of the multi-channel output audio signal.

Spatial audio processing

A method comprising: in response to a determination that a user is not consuming or not fully consuming virtual content, rendering to the user, a real-time notification in response to real-time virtual content consumable by the user, wherein the real-time notification directs a user to adopt a particular orientation in the real space for starting or augmenting consumption, of the real-time virtual content.

Methods, apparatus, systems, computer programs for enabling consumption of virtual content for mediated reality

An apparatus for audio signal processing audio objects within at least one audio scene, the apparatus comprising at least one processor configured to:define for at least one time period at least one contextual grouping comprising at least two of a plurality of audio objects and at least one further audio object of the plurality of audio objects outside of the at least one contextual grouping, the plurality of audio objects within at least one audio scene; anddefine with respect to the at least one contextual grouping at least one first parameter and/or parameter rule type which is configured to be applied with respect to a common element associated with the at least two of the plurality of audio objects and wherein the at least one first parameter and/or parameter rule type is configured to be applied with respect to individual element associatedwith the at least one further audio object outside of the at least one contextual grouping, the at least one first parameter and/or parameter rule type being applied in audio rendering of both the at least two of the plurality of audio objects and the at least one further audio object.

An apparatus for spatial audio signal encoding, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: determine, for two or more audio signals, at least one spatial audio parameter for providing spatial audio reproduction, the at least one spatial audio parameter comprising a direction parameter with an elevation and an azimuth component; define a spherical grid generated by covering a sphere with smaller spheres, wherein the centres of the smaller spheres define points of the spherical grid; and convert the elevation and azimuth component of the direction parameter to an index value based on the defined spherical grid.

Determination of spatial audio parameter encoding and associated decoding

An audio processing technique including obtaining a multi-channel audio signal, a first sound direction of interest and a second sound direction of interest; determining, for one or more frequency bands, a respective first range of sound directions encompassed by a first focus pattern directed to said first sound direction of interest and a respective second range of sound directions encompassed by a second focus pattern directed to said second sound direction of interest; determining, for said one or more frequency bands, respective overlap between the first and second ranges of sound directions; and deriving, based on the multi-channel audio signal and in accordance with said first and second focus patterns, a processed audio signal where sounds in said first and second sound directions of interest are emphasized in relation to sounds in other sound directions, said derivation including controlling emphasis in dependence of the determined overlap.

Audio processing

An apparatus configured: based on a point of interest identified in one or more instances of virtual reality content comprising at least visual imagery and data to provide a virtual reality space in which the visual imagery is displayed; and based on context information for at least one of the instances of the virtual reality content, the context information defining the extent of a virtual sub-volume of the virtual reality space that includes the point of interest; to provide for display of a virtual-reality-content-review-space to a user comprising a space in which a VR preview of the instances of virtual reality content is displayed at a location spaced from a point of view of the user, the or each VR preview comprising the respective sub-volume defined by the context information for providing the user with an understanding of the virtual reality space around the point of interest.

Apparatus and associated methods for display of virtual reality content

A method is provided, comprising: preventing rendering of specific audio in a virtual space to a user through virtual reality; enabling the user to explore the virtual space through user-perspective controlled virtual reality without hearing the specific audio; and in response to an interrupt, performing a visual transition to audio-visual content comprising the specific audio and visual content associated with the specific audio and then rendering specific audio and the visual content associated with the specific audio in the virtual space to the user through virtual reality.

Virtual reality

An apparatus configured, based on virtual reality content for viewing in virtual reality, the virtual reality content comprising visual content for display in a three dimensional virtual reality space and spatial audio content comprising audio for presentation such that it is audibly perceived to originate from one or more particular directions in the virtual reality space corresponding to one or more points or regions in the visual content, the virtual reality content defining at least a ground level of said virtual reality space; and based on display of a birds-eye view of the virtual reality space to a user comprising a view of the visual content substantially downward towards said ground level from a point of view location in said virtual reality space elevated from said ground level; to provide for presentation of said spatial audio content with a spatial audio modification, the spatial audio modification configured to modify the one or more particular directions from which the user perceives the spatial audio as being heard in an upward direction relative to said ground level at least for spatial audio content having a particular direction that is outside a field of view of said birds-eye view.

Apparatus and associated methods for presentation of a bird's eye view

An apparatus for spatial audio signal encoding, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: determine, for two or more audio signals, at least one spatial audio parameter for providing spatial audio reproduction, the at least one spatial audio parameter comprising a direction parameter with an elevation and an azimuth component; define a spherical grid generated by covering a sphere with smaller spheres, the smaller spheres arranged in circles of spheres wherein a first circle of spheres comprises one of the smaller spheres located with a centre at an elevation of 90 degrees relative to a reference direction of the sphere; and convert the elevation and azimuth component of the direction parameter to an index value based on the defined spherical grid.

Growing community of inventors

Tempere, Finland

Mikko Tapio Tammi