Amazon Technologies, Inc.

Daniel Korzekwa

Thomas Edward Merritt

Roberto Barra Chicote

Abdelhamid Ezzerg

Kamil Pokora

Piotr Tadeusz Bilinski

Adam Franciszek Nadolski

Nikhil Sharma

Kayoko Yanagisawa

Bartosz Putrycz

Marco Nicolis

Rafal Kuklinski

Wiktor Dolecki

Sebastian Dariusz Cygert

Raghu Ram Sreepada Srinivas

Voice customization is an application of voice synthesis that involves synthesizing speech having certain voice characteristics, and/or modifying the voice characteristics of human speech. Certain techniques for voice customization may be used in conjunction with compressing speech for storage and/or transmission. For example, speech may be received at a first device and transformed into a latent representation and/or compressed for storage and/or transmission to a second device. The system may use normalizing flows to transform the source audio to a latent representation having a desired variable distribution, and to transform the latent representation back into audio data. A flow model may conditioned using first speech attributes when transforming the source audio, and an inverse flow model may use second speech attributes when transforming the latent representation back into audio data. The first and/or second speech attributes may be modified to alter voice characteristics of the transmitted speech.

Voice customization for synthetic speech generation

Techniques for generating customized synthetic voices personalized to a user, based on user-provided feedback, are described. A system may determine embedding data representing a user-provided description of a desired synthetic voice and profile data associated with the user, and generate synthetic voice embedding data using synthetic voice embedding data corresponding a profile associated with a user determined to be similar to the current user. Based on user-provided feedback with respect to a customized synthetic voice, generated using synthetic voice characteristics corresponding to the synthetic voice embedding data and presented to the user, and the synthetic voice embedding data, the system may generate new synthetic voice embedding data, corresponding to a new customized synthetic voice. The system may be configured to assign the customized synthetic voice to the user, such that a subsequent user may not be presented with the same customized synthetic voice.

User-customized synthetic voice

During text-to-speech processing, audio data corresponding to a word part, word, or group of words is generated using a trained model and used by a unit selection engine to create output audio. The audio data is generated at least when an input word is unrecognized or when a cost of a unit selection is too high.

Text-to-speech (TTS) processing

Growing community of inventors

Gdansk, Poland

Daniel Korzekwa