Dolby Laboratories Licensing Corporation

Dolby International Ab

Michael Getty Horgan

Vivek Kumar

Xiaoyu Liu

Cristina Michel Vasco

Roy M Fejgin

Cong Zhou

Jaime H Morales

Paul Holmberg

Jordi Pons Puig

Berkan Kadioglu

Novel methods and systems for adapting a voice cloning synthesizer for a new speaker using real speech data are disclosed. Utterances from one or more target speakers are parameterized and are used to initialize an embedding vector for use with a voice synthesizer, by means of clustering the utterance data and determining the centroid of the data, using a speaker identification neural network, and/or by finding the closest stored embedded vector to the utterance data.

Systems and methods for adapting human speaker embeddings in speech synthesis

Computer-implemented methods for speech synthesis are provided. A speech synthesizer may be trained to generate synthesized audio data that corresponds to words uttered by a source speaker according to speech characteristics of a target speaker. The speech synthesizer may be trained by time-stamped phoneme sequences, pitch contour data and speaker identification data. The speech synthesizer may include a voice modeling neural network and a conditioning neural network.

Speech style transfer

Growing community of inventors

San Francisco, CA, United States of America

Michael Getty Horgan