Tencent Technology (shenzhen) Company Limited

Tencent Technology Company Limited

Shilun Lin

Li Hui Lu

Bo Dong Liu

Bo Liu

Xinhui Li

Xilin Zhang

Xiucai Jiang

Wenhua Ma

Embodiments of this application provide an audio processing method and apparatus, a vocoder, an electronic device, and a computer-readable storage medium. The audio processing method includes performing speech feature conversion on a text to obtain at least one acoustic feature frame; extracting a conditional feature corresponding to each acoustic feature frame from each acoustic feature frame of the at least one acoustic feature frame by a frame rate network; performing frequency division and time-domain down-sampling on the current frame of each acoustic feature frame to obtain n subframes corresponding to the current frame; synchronously predicting sample values corresponding to the current m adjacent sampling points on the n subframes to obtain m×n sub-prediction values; obtaining an audio prediction signal corresponding to the current frame; and performing audio synthesis on the audio prediction signal corresponding to each acoustic feature frame to obtain a target audio corresponding to the text.

Audio processing method and apparatus, vocoder, electronic device, computer-readable storage medium, and computer program product

A concealed text feature corresponding to a text data block of a plurality of text data blocks included in the text data and at least one concealed text feature corresponding to at least one text data block subsequent to the text data block are generated. A coarse fusion is performed on (i) the concealed text feature corresponding to the text data block and (ii) the at least one concealed text feature corresponding to the at least one text data block subsequent to the text data block to obtain at least one coarse fusion text feature. A fine fusion is performed on the at least one coarse fusion text feature to obtain a fine fusion text feature corresponding to the text data block. A length corresponding to the fine fusion text feature is regulated. The fine fusion text feature with the regulated length is transformed into the acoustic feature.

Transforming text data into acoustic feature

This application discloses a method, an apparatus, a computer readable medium, and an electronic device for audio synthesis. The method includes: acquiring mixed language text information comprising text characters corresponding to at least two language types; performing text coding processing on the mixed language text information based on the at least two language types, to obtain an intermediate semantic coding feature of the mixed language text information; acquiring a target tone feature corresponding to a target tone subject, and performing decoding processing on the intermediate semantic coding feature based on the target tone feature to obtain an acoustic feature; and performing acoustic coding processing on the acoustic feature to obtain an audio corresponding to the mixed language text information.

Audio synthesis method and apparatus, computer readable medium, and electronic device

A speech recognition method includes: obtaining speech information; and determining beginning and ending positions of a candidate speech segment in the speech information by using a weighted finite state transducer (WFST) network. The candidate speech segment is identified as corresponding to a preset keyword. The method also includes clipping the candidate speech segment from the speech information according to the beginning and ending positions of the candidate speech segment; detecting whether the candidate speech segment includes a preset keyword by using a machine learning model; and determining, upon determining that the candidate speech segment comprises the preset keyword, that the speech information comprises the preset keyword.

Growing community of inventors

Shenzhen, China

Shilun Lin