Lg Electronics Inc.

Tung Chin Lee

Sejin Oh

Soojin Hwang

Jongyeul Suh

Ling Li

A method for decoding a bitstream by an apparatus, includes obtaining a decoded audio signal and metadata from the bitstream, the metadata comprising scene orientation information; and rendering the decoded audio signal based on the scene orientation information, wherein the scene orientation information is information for a direction of a video scene related to the decoded audio signal.

Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same

Disclosed are an audio encoding method, to which BRIR/RIR parameterization is applied, and a method and device for reproducing audio by using parameterized BRIR/RIR information. The audio encoding method according to the present invention comprises the steps of: when an input audio signal is a binaural room impulse response (BRIR), dividing the input audio signal into a room impulse response (RIR) and a head-related impulse response (HRIR); applying a mixing time to the divided RIR or an RIR, which is input without division when the audio signal is the RIR, and dividing the mixing time-applied RIR into a direct/early reflection part and a late reverberation part; parameterizing a direct part characteristic on the basis of the divided direct/early reflection part; parameterizing an early reflection part characteristic on the basis of the divided direct/early reflection part; parameterizing a late reverberation part characteristic on the basis of the divided late reverberation part; and when the input audio signal is the BRIR, adding the divided HRIR and information of the parameterized RIR characteristic to an audio bitstream, and transmitting the same.

Audio encoding method, to which BRIR/RIR parameterization is applied, and method and device for reproducing audio by using parameterized BRIR/RIR information

The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.

Method of transmitting 360-degree video, method of receiving 360-degree video, device for transmitting 360-degree video, and device for receiving 360-degree video

The present invention pertains to an audio playback method and an audio playback apparatus in a 6DoF environment. The audio playback method of the present invention is characterised by comprising: a decoding step of decoding a received audio signal, and outputting the decoded audio signal and metadata; a modelling step of receiving input of position information of a user, checking whether the position of the user has changed from a previous position, and if the position of the user has changed, modelling binaural rendering data so as to correspond to the changed position of the user; and a rendering step of binaural-rendering the decoded audio signal using the modelled rendering data, and outputting the same as a two-channel audio signal. The audio playback method and apparatus in a 6DoF environment according to an embodiment of the present invention uses position change information of a user, changes the volume and depth of a sound source together according to the position of a user, and can thereby facilitate playback of a stereoscopic and realistic audio signal.

Audio playback method and audio playback apparatus in six degrees of freedom environment

Disclosed are method and device for outputting audio linked with a video screen zoom. The method of the present invention comprises the steps of: receiving an audio signal linked with a video and generating a decoded audio signal and object metadata; linking with an execution of a video screen zoom so as to change respective object gain values for objects which are present in a zoom area; and rendering the decoded audio signal by using the changed object gain values. In addition, the method for outputting audio, of the present invention, further comprises a step for changing a channel signal-specific gain value which is linked with the video screen zoom. An audio can be linked, through the method and device for outputting audio, according to an embodiment of the present invention, in accordance with the video screen zoom such that the audio which is more realistic can be provided.

Method and device for outputting audio linked with video screen zoom

A three-dimensional audio playing method and playing apparatus are disclosed. The three-dimensional audio playing method according to the present invention comprises: a decoding step of decoding a received audio signal and outputting the decoded audio signal and metadata; a room impulse response (RIR) decoding step of decoding RIR data when the RIR data is included in the received audio signal; a head-related impulse response (HRIR) generation step of generating HRIR data by using user head information when the RIR data is included in the received audio signal; a binaural room impulse response (BRIR) synthesis step of generating BRIR data by synthesizing the decoded RIR data and modeled HRIR data; and a binaural rendering step of outputting a binaural rendered audio signal by applying the generated BRIR data to the decoded audio signal. In addition, the three-dimensional audio playing method and playing apparatus, according to the present invention, support a 3DoF environment and a 6DoF environment. Moreover, the three-dimensional audio playing method and playing apparatus according to the present invention provide parameterized BRIR or RIR data. The three-dimensional audio playing method according to an embodiment of the present invention enables a more stereophonic and realistic three-dimensional audio signal to be provided.

Three-dimensional audio playing method and playing apparatus

A method for outputting an audio signal corresponding to scene orientation information is disclosed. The method includes receiving an audio signal interacting with a video, generating a decoded audio signal, object metadata, and scene orientation information through decoding, receiving external control information, and generating modified object metadata suitable for a playback environment by modifying the object metadata based on the received external control information, rendering the decoded audio signal using the modified object metadata, and modifying the rendered audio signal according to the scene orientation information.

A method and apparatus of/for providing subtitles for a 360-degree content, the method including generating 360-degree video data captured by at least one camera; stitching the 360-degree video data; projecting the 360-degree video data to a 2D image; encoding the 2D image into a video stream; generating a 360-degree subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360-degree content; inserting the 360-degree subtitle SEI message into the video stream; and generating a signal including the video stream, and transmitting the signal.

Method of providing fixed region information or offset region information for subtitle in virtual reality system and device for controlling the same

Disclosed are a distance rendering method used for audio signal output and an audio signal output apparatus using the same. The distance rendering method includes receiving a decoded audio signal, checking whether a distance between a user and a sound image is changed, if the distance is changed, calculating a gain parameter gand a period parameter&#x3c4;, applied to room response modeling, based on the changed distance, so as to maintain a space characteristic, and generating room response modeling for maintaining the space characteristic even when the distance is changed, using the calculated period parameter &#x3c4;and gain parameter g.

Distance rendering method for audio signal and apparatus for outputting audio signal using same

A method of interpolating a head-related transfer function (HRTF) and an audio output apparatus using the same are disclosed. The method includes receiving HRTF data corresponding to a point at which an altitude angle and an azimuth angle cross and receiving complementary information about a point at which the HRTF data is present, generating an HRTF interpolation signal corresponding to an altitude angle of a sound localization point, using HRTF data corresponding to two points constituting an altitude angle segment nearest the sound location point, calculating an amount of variation up to an azimuth angle &#x3b8; of the sound localization point, using complementary information of two points constituting an azimuth angle segment nearest the sound localization point, and generating a final HRTF interpolation signal corresponding to the sound localization point by applying the amount of variation to the HRTF interpolation signal corresponding to the altitude angle of the sound localization point.

Growing community of inventors

Seoul, South Korea

Tung Chin Lee