Nokia Technologies Oy

Nokia Corporation

Anssi Sakari Rämö

Lasse Juhani Laaksonen

Adriana Vasilache

Mikko Tapio Tammi

Arto Juhani Lehtiniemi

Miikka Tapani Vilermo

Ravi Shenoy

Toni Mäkinen

Jussi Artturi Leppänen

Erika Reponen

Sampo Vesa

Ari Heikkinen

Sakari Himanen

Antti Johannes Eronen

Jani Kristian Nurminen

Joonas Nikunen

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: determining a direction of arrival of sound from a sound source relative to a user device using at least one captured audio signal; controlling an angle of orientation of visual information displayed on a display, wherein the angle of orientation of the visual information is at least partially dependent upon the determined direction of arrival of sound from the sound source relative to the user device.

Apparatus, a method and a computer program for rotating displayed visual information

Audio capture in presence of noise

A method comprising determining that an orientation of a mobile device is a flat orientation, determining a context of the mobile device, determining movement of the mobile device, and based on the orientation, context and movement of the device, determining orientation of visual content rendered on a display of the mobile device.

Orientation of visual content rendered on a display of a mobile device

An apparatus comprising means for: receiving values for sub-bands of a frame of an audio signal, the values comprising at least one azimuth value, at least one elevation value and at least one energy ratio value for each sub-band; determining an allocation of first number of bits to encode the values of the frame, wherein the first number of bits are fixed; encoding the at least one energy ratio value for a frame based on a defined allocation of a second number of bits from the first number of bits; encoding the at least one azimuth value and/or at least one elevation value of the frame based on a defined allocation of a third number of bits from the first number of bits, wherein the third number of bits is variably distributed on a sub-band-by-sub-band basis.

Determination of spatial audio parameter encoding and associated decoding

An apparatus, method and computer program is described comprising: receiving a near-field audio source signal from a near-field microphone (); receiving a far-field audio signal from an array comprising one or more far-field microphones (); determining a filter length of a first portion of a room impulse response filter for the near-field microphone, wherein said filter length of said first portion is the same at each of a plurality of frequency bands of the filter and wherein said filter length of said first portion includes a direct acoustic propagation delay; and determining a filter length of a second portion of the room impulse response filter at each of the plurality of frequency bands, wherein the filter length of said second portion is frequency-dependent.

Processing audio signals

An apparatus for spatial audio signal encoding, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: determine, for two or more audio signals, at least one spatial audio parameter for providing spatial audio reproduction, the at least one spatial audio parameter comprising a direction parameter with an elevation and an azimuth component; define a spherical grid generated by covering a sphere with smaller spheres, wherein the centres of the smaller spheres define points of the spherical grid; and convert the elevation and azimuth component of the direction parameter to an index value based on the defined spherical grid.

A method apparatus, and computer program, the method comprising: storing mediated reality content and associated information relating to a first real space in which the mediated reality content has been displayed; selecting the mediated reality content for display in a second real space; obtaining information relating to the second real space; and using the information relating to the first real space and the information relating to the second real space to adapt the mediated reality content for display in the second real space.

Rendering mediated reality content

An apparatus for spatial audio signal encoding, the apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: determine, for two or more audio signals, at least one spatial audio parameter for providing spatial audio reproduction, the at least one spatial audio parameter comprising a direction parameter with an elevation and an azimuth component; define a spherical grid generated by covering a sphere with smaller spheres, the smaller spheres arranged in circles of spheres wherein a first circle of spheres comprises one of the smaller spheres located with a centre at an elevation of 90 degrees relative to a reference direction of the sphere; and convert the elevation and azimuth component of the direction parameter to an index value based on the defined spherical grid.

An apparatus configured to use captured spatial audio content captured by a rotatable spatial audio capture microphone array, the captured spatial audio content defining the three-dimensional arrangement of the audio in the scene, an orientation of the aural scene defined relative to the microphone array at the time of audio capture, and use captured direction data representative of the direction of a reference direction of said microphone array relative to the scene over a time during which said spatial audio content was captured; to generate modified spatial audio content in which the aural scene is decoupled from any rotation of the rotatable spatial audio capture microphone array that occurred during capture of the spatial audio content for presentation to the recipient user relative to a space in which the recipient user is located by virtue of modification of the orientation of the aural scene using the captured direction data.

Apparatus and associated methods

A method comprising: receiving lattice vector quantised parameter data, the parameter data representing at least one audio signal; determining within the data at least one bit error; and controlling the decoding of the data to generate an audio signal based on the determining of the bit error.

Bit error detector for an audio signal decoder

An apparatus comprising: a channel analyzer configured to determine for a first frame of at least one audio signal a set of first frame audio signal multi-channel parameters; a multichannel parameter selector configured to select for the first frame a sub-set of the set of first frame audio signal multi-channel parameters based on a value associated with the first frame; and a multichannel parameter encoder configured to generate an encoded first frame audio signal multi-channel parameter based on the selected sub-set of the set of first frame audio signal multi-channel parameters.

Audio signal encoder comprising a multi-channel parameter selector

A method comprising: receiving at least one audio channel signal; receiving at least one user interface input; generating a visualization of the at least one audio channel signal dependent on the at least one user interface input; and rendering the at least one audio channel signal to generate a rendered audio signal dependent on the at least one user interface input wherein the rendered audio channel signal is substantially synchronized with the visualization of the at least one audio channel signal.

Visual spatial audio

It is inter alia disclosed to quantize a vector of a plurality of coefficients using a predictive mode of operation of a vector quantizer, wherein the vector quantizer can operate in either a predictive mode of operation or a non-predictive mode of operation, determine a vector of a plurality of recovered coefficients; compare the vector of the plurality of coefficients to the vector of the plurality of recovered coefficients; and determine the mode of operation of the vector quantizer for a vector of a plurality of coefficients associated with a subsequent frame of audio samples, wherein the mode of operation is dependent on the comparison.

Method and apparatus for resilient vector quantization

It is disclosed inter alia a method for forming an audio payload frame, wherein the audio payload frame comprises: an encoded audio data frame with a first marker bit at the front of the encoded audio data frame, wherein the first marker is set to a first value, and wherein the first value denotes a type of encoded audio data in the encoded audio data frame; an extension encoded audio data frame; and a second marker bit in front of the first marker bit, wherein the second marker bit is set to a second value; and wherein the second value denotes a type of encoded audio data other than the type of encoded audio data in the encoded audio data frame.

Methods, apparatuses for forming audio signal payload and audio signal payload

It is disclosed inter alia a method comprising: estimating a value of entropy for a multi-channel audio signal; determining a channel configuration of the multi-channel audio signal from the value of entropy; and encoding the multi-channel audio signal, wherein the mode of encoding is dependent on the channel configuration.

Growing community of inventors

Tampere, Finland

Anssi Sakari Rämö