Monsters Aliens Robots Zombies Inc.

Lon Molnar

Thomas Davies

Ali Mahdavi-Amiri

Jonathan Bronfman

Matthew Panousis

Anton Skourides

Paul Birulin

Debjoy Chowdhury

Ishrat Badami

Daniel Cohen-Or

Ahmed Moustafa Abdelhafez Hashem

A computer implemented system is described in various embodiments herein, the system includes a processor, a memory coupled to the processor and storing processor-executable instructions that, when executed, configure the processor to: receive an initial video data object V comprising a plurality of image frame data objects I; receive a set of time-synchronized viseme parameters corresponding to target audio data object A'; and process the initial video data object V and the set of time-synchronized viseme parameters using a machine learning network to generate an output video data object V′, wherein initial mouth regions in the initial video data object V have been replaced with replacement mouth regions generated based on the set of time-synchronized viseme parameters.

Systems and methods for improved lip dubbing

An image processing system comprising: a computer readable medium and at least one processor configured to provide a machine learning architecture for image processing. In particular, modified keyframes are used for training the machine learning architecture. The modifications are then automatically propagated to remaining frames requiring modification through interpolation or extrapolation through processing remaining frames through the trained machine learning architecture. The generated modified frames or frame portions can then be inserted into an original video to generate a modified video where the modifications have been propagated. Example usages include automatic computational approaches for aging/de-aging and addition/removal of tattoos or other visual effects.

Method and system for image processing

An image processing system comprising: a computer readable medium and at least one processor configured to provide a machine learning architecture for image processing. In particular, keyframes are selected for modification by a visual artist, and the modifications are used for training the machine learning architecture. The modifications are then automatically propagated to remaining frames requiring modification through interpolation or extrapolation through processing remaining frames through the trained machine learning architecture. The generated modified frames or frame portions can then be inserted into an original video to generate a modified video where the modifications have been propagated. Example usages include automatic computational approaches for aging/de-aging and addition/removal of tattoos or other visual effects.

Growing community of inventors

Toronto, Canada

Lon Molnar