Nanjing Silicon Intelligence Technology Co., Ltd.

Ao Yao

Huapeng Sima

Yiping Tang

Da Jiang

Haie Wu

Embodiments of the present application provide a speech conversion method and apparatus, a storage medium, and an electronic device. The method includes: acquiring a source speech to be converted and a target speech sample of a target speaker; recognizing a style category of the target speech sample, and extracting a target audio feature from the target speech sample according to the style category; extracting a source audio feature from the source speech; acquiring a first style feature of the target speech sample and determining a second style feature of the target speech sample according to the first style feature; fusing and mapping the source audio feature, the target audio feature, and the second style feature to obtain a joint encoding feature; and decoding the joint encoding feature, to obtain a target speech feature, and converting the source speech based on the target speech feature to obtain a target speech.

Speech conversion method and apparatus, storage medium, and electronic device

This application provide a synthetic audio output method and apparatus, a storage medium, and an electronic device. The method includes: inputting input text and a specified target identity identifier into an audio output model; extracting an identity feature sequence of a target identity by an identity recognition model; extracting a phoneme feature sequence corresponding to the input text by an encoding layer of a speech synthesis model; superimposing and inputting the identity feature sequence of the target identity and the phoneme feature sequence into a variable adapter of the speech synthesis model; and after duration prediction and alignment, energy prediction, and pitch prediction are performed on the phoneme feature sequence by the variable adapter, outputting a target Mel-frequency spectrum feature corresponding to the input text through a decoding layer of the speech synthesis model; and inputting the target Mel-frequency spectrum feature into a vocoder to output synthetic audio.

Synthetic audio output method and apparatus, storage medium, and electronic device

The present invention relates to the field of intelligent recognition, and discloses an intent recognition method based on a deep learning network, resolving a technical problem that accuracy of intent recognition is not high. A key point of the technical solutions is migrating features of a first deep learning network to a second deep learning network, mainly including: converting data sets of all fields into a word sequence WS and a corresponding PINYIN sequence PS; meanwhile, manually labeling the data set of a certain field and converting the data set into a word sequence WD, a PINYIN sequence PD, and a label; inputting the word sequence WS and the PINYIN sequence PS to the first deep learning network for training to obtain a language model, initializing and updating an encoding layer parameter matrix of the language model; and weighting and inputting the word sequence WD and the PINYIN sequence PD to the second deep learning network after the word sequence WD and the PINYIN sequence PD are inputted to the second deep learning network to be encoded, to train an intent recognition model. Accuracy of performing intent recognition by using the intent recognition model is higher.

Growing community of inventors

Nanjing, China

Ao Yao