Electronics and Telecommunications Research Institute

Kwangwoon University Industry-academic Collaboration Foundation

Indiana University

Yonsei University

The Korea Development Bank

Gwangju Institute of Science and Technology

Nippon Hoso' Kyokai

Kyonggi University Industry & Academia Cooperation Foundation

Chung Ang University Industry Academic Cooperation

Etri

Tae Jin Lee

Seung Kwon Beack

Dae Young Jang

Kyeongok Kang

Jong Mo Sung

Yong Ju Lee

Jin Woong Kim

Kyeong Ok Kang

Jeongil Seo

Young-cheol Park

Jongmo Sung

Jin Woo Hong

Jeong Il Seo

Min Soo Kim

Woo-taek Lim

Hochong Park

Chieteuk Ahn

Inseon Jang

Jin Soo Choi

Jae Hyoun Yoo

Jae-hyoun Yoo

Mi Suk Lee

Young Ho Jeong

Keun Woo Choi

Ho Chong Park

Jin-Woo Hong

Seung-Kwon Baek

Min Je Kim

Tae Jin Park

Seungkwon Beack

Minje Kim

Hui Yong Kim

Seok Pil Lee

Soo Young Park

In Seon Jang

Chie Teuk Ahn

Young Cheol Park

Kai Zhen

Byeongho Cho

Seung Kwon Baek

Kaoru Watanabe

Sang Won Suh

Satoshi Oode

Byeong Ho Cho

Youngju Cheon

Soojoong Hwang

Sangwook Han

Ikuko Sawaya

Jihyun Lee

Sang Wook Kim

Ji Hyun Lee

Chanwoo Lee

Hong Goo Kang

Jongwon Shin

Hyoung Soo Lim

Hong-Goo Kang

Chan Woo Lee

Young-Cheol Park

Woo Taek Lim

Kyu Tae Yang

Bong Ho Lee

Jong Won Shin

Seok Jin Lee

Jeong Ii Seo

Jong-Won Seok

Seung Chul Ham

Seung Kwon Baeck

Hyungseob Lim

Joon Byun

Seungmin Shin

Haici Yang

Hyung Seob Lim

SeungChul Ham

Seong-Hyeon Shin

Yunsu Kim

Seungchul Ham

A method for encoding an input signal using N flow blocks (N is a natural number greater than or equal to 2) and (N−1) split block(s), which is performed by a processor, may comprise: transmitting, by a k-th flow block (k is a natural number greater than or equal to 1 and less than or equal to N−1) among the N flow blocks, a k-th transformation signal obtained by transforming a received signal into a latent representation to a k-th split block among the (N−1) split block(s); splitting, by the k-th split block, the k-th transformation signal by a predetermined ratio, into a first split signal and a second split signal; transmitting, by the k-th split block, the first split signal to a (k+1)-th flow block; and quantizing a signal transformed by an N-th flow block and the second split signals using a quantization block.

Method for encoding and decoding audio signal using normalizing flow, and training method thereof

A rendering method of an object-based audio signal and an apparatus for performing the same are provided. The rendering method of an object-based audio signal includes obtaining a rendered audio signal, performing clipping prevention on the rendered audio signal using a first limiter, mixing a signal output by the first limiter using a mixer, and performing clipping prevention on the mixed signal using a second limiter.

Rendering method of preventing object-based audio from clipping and apparatus for performing the same

A method of rendering object-based audio and an electronic device for performing the method are disclosed. The method includes identifying metadata of the object-based audio, determining whether the metadata includes a parameter set for an atmospheric absorption effect for each distance, and rendering the object-based audio, using a distance between the object-based audio and a listener obtained using the metadata and the atmospheric absorption effect according to an effect of a medium attenuation based on the parameter, when the metadata includes the parameter.

Method of rendering object-based audio and electronic device for performing the method

An audio signal processing apparatus and an audio signal processing method are disclosed. The audio signal processing method performed by the audio signal processing apparatus includes determining whether a line of sight between a render item (RI) corresponding to an audio element and a listener is visible, based on a bitstream, in response to a case where the line of sight is invisible, generating an audio signal by rendering a diffraction-type RI corresponding to the RI, and outputting the audio signal.

Audio signal processing apparatus and audio signal processing method

A method and apparatus for processing acoustic spatial information are provided. The method of processing acoustic spatial information includes identifying at least one mesh disposed in an acoustic space, setting a minimum cuboid surrounding the mesh as a bounding box, and generating acoustic spatial information including information about the bounding box.

Method and apparatus for processing acoustic spatial information

A Unified Speech and Audio Codec (USAC) that may process a window sequence based on mode switching is provided. The USAC may perform encoding or decoding by overlapping between frames based on a folding point when mode switching occurs. The USAC may process different window sequences for each situation to perform encoding or decoding, and thereby may improve a coding efficiency.

Unified speech/audio codec (USAC) processing windows sequence based mode switching

A method of encoding a speech signal includes predicting a feature vector of each of a plurality of frames included in the speech signal based on a ground-truth feature vector of a previous frame of each of the plurality of frames, calculating a residual signal corresponding to each of the plurality of frames based on a ground-truth feature vector of each of the plurality of frames and a predicted feature vector of each of the plurality of frames, and generating a bitstring corresponding to each of the plurality of frames by quantizing the residual signal.

Speech coding method and apparatus for performing the same

Disclosed is an apparatus and method for audio encoding/decoding that is robust against coding distortion in a transition section. An audio encoding method includes outputting a frequency domain signal by time-to-frequency (T/F) transform of an input signal, outputting a frequency domain residual signal in which a frequency axis envelope is removed from the frequency domain signal by applying frequency domain noise shaping (FDNS) encoding to the frequency domain signal, outputting a time domain residual signal in which a time axis envelope is removed by performing linear prediction coefficient (LPC) analysis based on the frequency domain residual signal, and quantizing and transmitting the time domain residual signal.

Apparatus and method for audio encoding/decoding robust to transition segment encoding distortion

An encoding method, a decoding method, an encoder for performing the encoding method, and a decoder for performing the decoding method are provided. The encoding method includes outputting LP coefficients bitstream and a residual signal by performing an LP analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, a second latent signal obtained by encoding a non-periodic component of the residual signal, and a weight vector for each of the first latent signal and the second latent signal, using a first neural network module, and outputting a first bitstream obtained by quantizing the first latent signal, a second bitstream obtained by quantizing the second latent signal, and a weight bitstream obtained by quantizing the weight vector, using a quantization module.

Encoding method, decoding method, encoder for performing encoding method, and decoder for performing decoding method

Provided is a method and apparatus for designing and testing an audio codec using quantization based on white noise modeling. A neural network-based audio encoder design method includes generating a quantized latent vector and a reconstructed signal corresponding to an input signal by using a white noise modeling-based quantization process, computing a total loss for training a neural network-based audio codec, based on the input signal, the reconstruction signal, and the quantized latent vector, training the neural network-based audio codec by using the total loss, and validating the trained neural network-based audio codec to select the best neural network-based audio codec.

Method and apparatus for designing and testing audio codec by using white noise modeling

Provided is an encoding apparatus for integrally encoding and decoding a speech signal and a audio signal, and may include: an input signal analyzer to analyze a characteristic of an input signal; a stereo encoder to down mix the input signal to a mono signal when the input signal is a stereo signal, and to extract stereo sound image information; a frequency band expander to expand a frequency band of the input signal; a sampling rate converter to convert a sampling rate; a speech signal encoder to encode the input signal using a speech encoding module when the input signal is a speech characteristics signal; a audio signal encoder to encode the input signal using a audio encoding module when the input signal is a audio characteristic signal; and a bitstream generator to generate a bitstream.

Apparatus for encoding and decoding of integrated speech and audio

An audio signal encoding and decoding method using a neural network model, and an encoder and decoder for performing the same are disclosed. A method of encoding an audio signal using a neural network model, the method may include identifying an input signal, generating a quantized latent vector by inputting the input signal into a neural network model encoding the input signal, and generating a bitstream corresponding to the quantized latent vector, wherein the neural network model may include i) a feature extraction layer generating a latent vector by extracting a feature of the input signal, ii) a plurality of downsampling blocks downsampling the latent vector, and iii) a plurality of quantization blocks performing quantization of a downsampled latent vector.

Audio signal encoding and decoding method using a neural network model to generate a quantized latent vector, and encoder and decoder for performing the same

Provided is an encoding method according to various example embodiments and an encoder performing the method. The encoding method includes outputting a linear prediction (LP) coefficients bitstream and a residual signal by performing a linear prediction analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, using a first neural network module, outputting a first bitstream obtained by quantizing the first latent signal, using a quantization module, outputting a second latent signal obtained by encoding an aperiodic component of the residual signal, using the first neural network module, and outputting a second bitstream obtained by quantizing the second latent signal, using the quantization module, wherein the aperiodic component of the residual signal is calculated based on a periodic component of the residual signal decoded from the quantized first latent signal output by de-quantizing the first bitstream.

Methods of encoding and decoding, encoder and decoder performing the methods

An encoding apparatus and a decoding apparatus in a transform between a Modified Discrete Cosine Transform (MDCT)-based coder and a different coder are provided. The encoding apparatus may encode additional information to restore an input signal encoded according to the MDCT-based coding scheme, when switching occurs between the MDCT-based coder and the different coder. Accordingly, an unnecessary bitstream may be prevented from being generated, and minimum additional information may be encoded.

Encoding apparatus and decoding apparatus for transforming between modified discrete cosine transform-based coder and different coder

A method and apparatus for rendering an object-based audio signal considering an obstacle are disclosed. A method for rendering an object-based audio signal according to an example embodiment, the method includes identifying an object-based input signal and metadata for the input signal, generating a binaural filter based on the metadata using a binaural room impulse response (BRIR), determining, based on the metadata, whether an obstacle is present between a listener and an object, modifying the generated binaural filter when it is determined that the obstacle is present, and generating a rendered output signal by convolving the modified binaural filter and the input signal.

Method and apparatus for rendering object-based audio signal considering obstacle

Growing community of inventors

Daejeon, South Korea

Tae Jin Lee