Electronics and Telecommunications Research Institute

Chung Ang University Industry Academic Cooperation

Jae-hyoun Yoo

Yong Ju Lee

Kyeongok Kang

Tae Jin Lee

Dae Young Jang

Chieteuk Ahn

Jin Woong Kim

Young Ho Jeong

Jin-Woo Hong

Jeongil Seo

Hwan Shim

Soo Young Park

Sang Won Suh

Hui Yong Kim

Jin Woo Hong

Sang Wook Kim

Jeong Il Seo

Kyeong Ok Kang

Woo-taek Lim

Mi Suk Lee

Keun Woo Choi

Hyunjoo Chung

Hyun-joo Chung

Koen-Mo Sung

A rendering method of an object-based audio signal and an apparatus for performing the same are provided. The rendering method of an object-based audio signal includes obtaining a rendered audio signal, performing clipping prevention on the rendered audio signal using a first limiter, mixing a signal output by the first limiter using a mixer, and performing clipping prevention on the mixed signal using a second limiter.

Rendering method of preventing object-based audio from clipping and apparatus for performing the same

A method of rendering object-based audio and an electronic device for performing the method are disclosed. The method includes identifying metadata of the object-based audio, determining whether the metadata includes a parameter set for an atmospheric absorption effect for each distance, and rendering the object-based audio, using a distance between the object-based audio and a listener obtained using the metadata and the atmospheric absorption effect according to an effect of a medium attenuation based on the parameter, when the metadata includes the parameter.

Method of rendering object-based audio and electronic device for performing the method

An audio signal processing apparatus and an audio signal processing method are disclosed. The audio signal processing method performed by the audio signal processing apparatus includes determining whether a line of sight between a render item (RI) corresponding to an audio element and a listener is visible, based on a bitstream, in response to a case where the line of sight is invisible, generating an audio signal by rendering a diffraction-type RI corresponding to the RI, and outputting the audio signal.

Audio signal processing apparatus and audio signal processing method

A method and apparatus for processing acoustic spatial information are provided. The method of processing acoustic spatial information includes identifying at least one mesh disposed in an acoustic space, setting a minimum cuboid surrounding the mesh as a bounding box, and generating acoustic spatial information including information about the bounding box.

Method and apparatus for processing acoustic spatial information

Provided is a method of processing mesh data for processing an audio signal for audio rendering in a virtual reality (VR) space. The method includes receiving mesh data defining geometry of a certain space and the mesh data includes data regarding three-dimensional (3D) coordinates of points for configuring spatial information of the certain space and processing the mesh data by identifying outermost points among the points.

Method of processing mesh data for processing audio signal for audio rendering in virtual reality space

Disclosed is an apparatus for immersive spatial audio modeling and rendering for effectively transmitting and playing immersive spatial audio content. The apparatus for immersive spatial audio modeling and rendering disclosed herein may model a spatial audio scene, generate and transmit parameters necessary for spatial audio rendering, and generate various spatial audio effects using the spatial audio parameters, to provide an immersive three-dimensional (3D) audio source coinciding with visual experience in a virtual reality space in response to free changes in the position and direction of a remote user in the space.

Apparatus for immersive spatial audio modeling and rendering

Provided is a method of reproducing an ambisonic signal in a virtual reality (VR) space. The ambisonic signal reproduction method may include receiving an ambisonic signal, mapping the ambisonic signal to channels localized on a sphere according to an equivalent spatial domain (ESD) standard corresponding to an order of the ambisonic signal, and performing a sound field reproduction in the VR space based on the channels localized on the sphere.

Method and apparatus for ambisonic signal reproduction in virtual reality space

A method and apparatus for rendering an object-based audio signal considering an obstacle are disclosed. A method for rendering an object-based audio signal according to an example embodiment, the method includes identifying an object-based input signal and metadata for the input signal, generating a binaural filter based on the metadata using a binaural room impulse response (BRIR), determining, based on the metadata, whether an obstacle is present between a listener and an object, modifying the generated binaural filter when it is determined that the obstacle is present, and generating a rendered output signal by convolving the modified binaural filter and the input signal.

Method and apparatus for rendering object-based audio signal considering obstacle

A method and system for processing an obstacle effect in a virtual acoustic space are disclosed. The method includes receiving a parameter for an obstacle candidate plane extracted from spatial information, determining, in response to the parameter, whether the obstacle candidate plane is an obstacle related to a path between a position of a virtual sound source and a position of a user, and applying a sound effect according to the obstacle to an audio signal when the obstacle candidate plane is the obstacle. The obstacle candidate plane is a plane of an object that may become the obstacle in a sound propagation path between the virtual sound source and the user.

Method and system for processing obstacle effect in virtual acoustic space

A method and apparatus for rendering a volume sound source are disclosed. The method of rendering a volume sound source may include identifying information about a listener and information about the volume sound source, determining a corresponding area in which a source element is disposed in the volume sound source in consideration of the information about the listener, determining an angle between the listener and the corresponding area based on the information about the listener and the information about the volume sound source, determining a number of source elements disposed in the corresponding area according to the angle, determining a position and a gain of the source element using i) the number of source elements and ii) a distance between the listener and the volume sound source, and rendering the volume sound source according to the position and the gain of the source element.

Method and apparatus for rendering volume sound source

An apparatus and method for pitch-shifting an audio signal with low complexity are disclosed. The method includes identifying a distance between an audio object included in the audio signal and a listener, checking whether the distance between the audio object and the listener decreases, and performing stepwise stretching pitch-shifting of repeatedly using at least one of frequency components of the audio signal when the distance between the audio object and the listener decreases.

Apparatus and method for pitch-shifting audio signal with low complexity

A method and apparatus for performing binaural rendering of an audio signal are provided. The method includes identifying an input signal that is based on an object, and metadata that includes distance information indicating a distance to the object, generating a binaural filter that is based on the metadata, using a binaural room impulse response, obtaining a binaural filter to which a low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information, and generating a binaural-rendered output signal by performing a convolution of the input signal and the binaural filter to which the LPF is applied.

Method and apparatus for performing binaural rendering of audio signal

An audio signal controlling method includes identifying whether an audio zooming effect is used for at least one audio object present in a virtual reality (VR) through an audio zooming effect field included in metadata, and controlling an audio signal corresponding to the audio object based on a preset method when the audio zooming effect is identified as being used.

Method and apparatus for controlling audio signal for applying audio zooming effect in virtual reality

The present invention relates to a system for transmitting and receiving audio, particularly, to a method and apparatus for transmitting and receiving of object-based audio contents, which packetizes audio objects having the same characteristic. To achieve the above, the present invention includes filtering a plurality of ESs according to common information, adding a packet header to the respective filtered ESs and generate ES packets, aggregating all the generated ES packets and then adding a multi-object packet header to the aggregated ES packets to generate an object packet, and multiplexing the generated object packet, packetizing the multiplexed object packet according to a transmitting media and transmitting the packetized object packet.

Method and apparatus for transmitting and receiving of the object-based audio contents

Disclosed is an audio signal processing method including identifying a sound source provided inside a preset reference distance and a sound source provided outside the reference distance to represent a sound field based on virtual reality (VR) content that is represented in a predetermined virtual space in which a user is located in a VR environment, processing a sound field using three-dimensional (3D) ambisonics based on height information and horizontal information of the sound source provided inside the reference distance, and processing a sound field using two-dimensional (2D) ambisonics based on horizontal information of the sound source provided outside the reference distance.

Growing community of inventors

Daejeon, South Korea

Jae-hyoun Yoo