Korea Electronics Technology Institute

Jong Yeol Yang

Choong Sang Cho

Hye Dong Jung

Young Han Lee

An audio segmentation method based on an attention mechanism is provided. The audio segmentation method according to an embodiment obtains a mapping relationship between an 'inputted text' and an 'audio spectrum feature vector for generating an audio signal', the audio spectrum feature vector being automatically synthesized by using the inputted text, and segments an inputted audio signal by using the mapping relationship. Accordingly, high quality can be guaranteed and the effort, time, and cost can be noticeably reduced through audio segmentation utilizing the attention mechanism.

Audio segmentation method based on attention mechanism

An audio synthesis method adapted to video characteristics is provided. The audio synthesis method according to an embodiment includes: extracting characteristics x from a video in a time-series way; extracting characteristics p of phonemes from a text; and generating an audio spectrum characteristic Sused to generate an audio to be synthesized with a video at a time t, based on correlations between an audio spectrum characteristic S, which is used to generate an audio to be synthesized with a video at a time t&#x2212;1, and the characteristics x. Accordingly, an audio can be synthesized according to video characteristics, and speech according to a video can be easily added.

Growing community of inventors

Yongin-si, South Korea

Jong Yeol Yang