Beijing Jingdong Century Trading Co., Ltd.

Beijing Jingdong Shangke Information Technology Co., Ltd.

Beijing Wodong Tianjun Information Technology Co., Ltd.

Zhengchen Zhang

Wei Song

Xiaodong He

Zhizheng Wu

Shuyong Liu

Junyi Wu

Xin Yuan

Yuyu Cai

Shuangwen Qiu

Yonghui Rao

Zhihang Xie

Junmin Lin

Guanghui Xu

Bosen Ma

A custom tone and vocal synthesis method and apparatus, an electronic device, and a storage medium. The synthesis method comprises: training a first neural network by means of a speaker record sample to obtain a speaker recognition model, the output training result of the first neural network being a speaker vector sample (S); training a second neural network by means of an unaccompanied vocal singing sample and the speaker vector sample to obtain an unaccompanied singing synthesis model (S); inputting a speaker record to be synthesized into the speaker recognition model to obtain speaker information output by the intermediate hidden layer of the speaker recognition model (S); and inputting unaccompanied singing music information to be synthesized and the speaker information into the unaccompanied singing synthesis model to obtain a synthesized custom tone and vocal (S).

Custom tone and vocal synthesis method and apparatus, electronic device, and storage medium

The present disclosure relates to a speech synthesis method and device, and a computer-readable storage medium, and relates to the field of computer technology. The method of the present disclosure includes: dividing a text into a plurality of segments according to a language category to which each of the segments belongs; converting each of the segments into a phoneme corresponding to the segment to generate a phoneme sequence of the text according to the language category to which each of the segments belongs; inputting the phoneme sequence into a speech synthesis model trained in advance and converting the phoneme sequence into a vocoder characteristic parameter; and inputting the vocoder characteristic parameter into a vocoder to generate a speech.

Speech synthesis method, device and computer readable storage medium

Growing community of inventors

Beijing, China

Zhengchen Zhang