Orange

France Telecom

Jérôme Daniel

Marc Emerit

Stéphane Ragot

Julien Faure

Andrzej Zielinski

Robert Warzocha

Robert Kolodynski

Method and device for processing a video sequence containing a succession of images of one or more participant speakers, captured by a wide-angle camera. The method includes: capturing sound using a microphone having a plurality of sensors for capturing a sound field; processing the audio data captured by the microphone in order to determine at least one direction of origin of sound coming from a participant, relative to an optical axis of the wide-angle camera; generating a signal including data concerning the direction of origin of the sound relative to the optical axis of the camera, for the purpose of utilizing the signal when rendering the captured images by zooming into an area around the participant emitting the sound for which the direction of origin corresponds to the data of the signal.

Processing of data of a video sequence in order to zoom to a speaker detected in the sequence

The invention concerns sound spatialization with multichannel encoding for binaural reproduction on two loudspeakers, the spatial encoding being defined by encoding functions associated with multiple encoding channels and the decoding by applying filters for binaural reproduction. The invention provides for an optimization as follows: a) obtaining a original set of acoustic transfer functions particular to an individual's morphology (HRIR;HRTF), b) selecting spatial encoding functions (g(&#x3b8;,&#x3c6;,n)) and/or decoding filters (F(t,n)), and c) through successive iterations, optimizing the filters associated with the selected encoding functions or the encoding functions associated with the selected filters, or jointly the selected filters and encoding functions, by minimizing an error (c(HRIR,HRIR*)) calculated based on a comparison between: the original set of transfer functions (HRIR), and a set of reconstructed transfer functions (HRIR*) from encoding functions and decoding filters, whether optimized and/or selected.

Optimization of binaural sound spatialization based on multichannel encoding

The invention concerns the processing of audio data. The invention is characterized in that it consists in: (a) encoding signals representing a sound propagated in three-dimensional space and derived from a source located at a first distance (P) from a reference point, to obtain a representation of the sound through components expressed in a spherical harmonic base, of origin corresponding to said reference point, (b) and applying to said components compensation of a near-field effect through filtering based on a second distance (R) defining, for sound reproduction, a distance between a reproduction point (HP), and a point (P) of auditory perception where a listener is usually located.

Method for processing audio data and sound acquisition device implementing this method

Growing community of inventors

Penvenan, France

Jérôme Daniel