University of Toronto

Jali Inc.

Chris Landreth

Karan Singh

Eugene Fiume

Pif Edwards

A system and method for triggering animated paralingual behavior from dialogue. The method including: receiving a corpus of dialogue including a plurality of samples, each sample including dialogue with aligned sequences of phonemes or sub-phonemes; extracting properties of measured quantities for each sample; generating a statistical profile by statistically classifying the extracted properties as a function of each sequence of phonemes or sub-phonemes; receiving a stream of phonemes or sub-phonemes and triggering paralingual behavior when the properties of any of the phonemes or sub-phonemes deviate from the statistical profile beyond a predetermined threshold; outputting the triggered paralingual behavior for animation.

System and method for triggering animated paralingual behavior from dialogue

A system and method for animated lip synchronization. The method includes: capturing speech input; parsing the speech input into phenomes; aligning the phonemes to the corresponding portions of the speech input; mapping the phonemes to visemes; synchronizing the visemes into viseme action units, the viseme action units comprising jaw and lip contributions for each of the phonemes; and outputting the viseme action units.

Growing community of inventors

Toronto, Canada

Chris Landreth