Snap Inc.

Wei Chu

Xin Chen

Zehao Xue

Chen Cao

Leonardo Ribas Machado Das Neves

William Brendel

Luis Carlos Dos Santos Marujo

Venkata Satya Pradeep Karuturi

Francesco Barbieri

The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.

Joint audio-video facial animation system

Symbol prediction can be implemented using a multi-task system trained for different tasks. The tasks may include a single symbol prediction, symbol category prediction, and symbol subcategory prediction. Categories of symbols can be generated by clustering sets of training data using a clustering scheme.

Pictorial symbol prediction

Systems, devices, media, and methods are presented for converting sounds in an audio stream. The systems and methods receive an audio conversion request initiating conversion of one or more sound characteristics of an audio stream from a first state to a second state. The systems and methods access an audio conversion model associated with an audio signature for the second state. The audio stream is converted based on the audio conversion model and an audio construct is compiled from the converted audio stream and a base audio segment. The compiled audio construct is presented at a client device.

Speech characteristic recognition and conversion

Growing community of inventors

Culver City, CA, United States of America

Wei Chu