Amazon Technologies, Inc.

Simon Slangen

Thomas Renaud Drugman

Panagiota Karanasou

Sri Vishnu Kumar Karlapati

Syed Ammar Abbas

Arnaud Vincent Pierre Yves Joly

Alexis Pierre Moinet

Alexis Pierre Jean-Baptiste Moinet

Bajibabu Bollepalli

Petr Makarov

Arnaud Joly

A speech-processing system receives input data representing text. One or more encoders trained to predict audio properties corresponding to the text process the text to predict those properties. A speech decoder processes phoneme embeddings as well as the predicted properties to create data representing synthesized speech.

Synthetic speech processing by representing text by phonemes exhibiting predicted volume and pitch using neural networks

Techniques for performing text-to-speech are described. An exemplary method includes receiving a request to generate audio from input text; generating audio from the input text by: generating a first number of vectors from phoneme embeddings representing the input text, predicting one or more spectrograms having the first number of frames using multiple scales wherein a coarser scale influences a finer scale, concatenating the first number of vectors and the predicted one or more spectrograms, generating at least one mel spectrogram from the concatenated vectors and the predicted one or more spectrograms, and converting, with a vocoder, the at least one mel spectrogram frames to audio; and outputting the generated audio according to the request.

Multi-scale spectrogram text-to-speech

A speech-processing system receives input data representing text. An input encoder processes the input data to determine first embedding data representing the text. A local attention encoder processes a subset of the first embedding data in accordance with a predicted size to determine second embedding data. An attention encoder processes the second embedding data to determine third embedding data. A decoder processes the third embedding data to determine audio data corresponding to the text.

Synthetic speech processing

Growing community of inventors

Edinburgh, United Kingdom

Simon Slangen