Adobe, Inc.

Mixamo, Inc.

Facebook, Inc.

Edilson De Aguiar

Stefano Koenig Corazza

Emiliano Gambaretto

Nazim Kareemi

Graham Taylor

Systems and methods are described for animating 3D characters using synthetic motion data generated by motion models in response to a high level description of a desired sequence of motion provided by an animator. In a number of embodiments, the synthetic motion data is streamed to a user device that includes a rendering engine and the user device renders an animation of a 3D character using the streamed synthetic motion data. In several embodiments, an animator can upload a custom model of a 3D character or a custom 3D character is generated by the server system in response to a high level description of a desired 3D character provided by the user and the synthetic motion data generated by the generative model is retargeted to animate the custom 3D character.

Web platform for interactive design, synthesis and delivery of 3D character motion data

Systems and methods are described for performing spatial and temporal compression of deformable mesh based representations of 3D character motion allowing the visualization of high-resolution 3D character animations in real time. In a number of embodiments, the deformable mesh based representation of the 3D character motion is used to automatically generate an interconnected graph based representation of the same 3D character motion. The interconnected graph based representation can include an interconnected graph that is used to drive mesh clusters during the rendering of a 3D character animation. The interconnected graph based representation provides spatial compression of the deformable mesh based representation, and further compression can be achieved by applying temporal compression processes to the time-varying behavior of the mesh clusters. Even greater compression can be achieved by eliminating redundant data from the file format containing the interconnected graph based representation of the 3D character motion that would otherwise be repeatedly provided to a game engine during rendering, and by applying loss-less data compression to the data of the file itself.

Data compression for real-time streaming of deformable 3D models for 3D animation

Systems and methods are described for animating 3D characters using synthetic motion data generated by generative models in response to a high level description of a desired sequence of motion provided by an animator. In a number of embodiments, an animation system is accessible via a server system that utilizes the ability of generative models to generate synthetic motion data across a continuum to enable multiple animators to effectively reuse the same set of previously recorded motion capture data to produce a wide variety of desired animation sequences. One embodiment of the invention includes a server system configured to communicate with a database containing motion data including repeated sequences of motion, where the differences between the repeated sequences of motion are described using at least one high level characteristic. In addition, the server system is configured to train a generative model using the motion data, the server system is configured to generate a user interface that is accessible via a communication network, to receive a high level description of a desired sequence of motion via the user interface, to use the generative model to generate synthetic motion data based on the high level description of the desired sequence of motion and to transmit a stream via the communication network including information that can be used to display a 3D character animated using the synthetic motion data.

Interactive design, synthesis and delivery of 3D motion data through the web

Systems and methods are described for animating 3D characters using synthetic motion data generated by generative models in response to a high level description of a desired sequence of motion provided by an animator. An animation system is accessible via a server system that utilizes the ability of generative models to generate synthetic motion data across a continuum to enable multiple animators to effectively reuse the same set of previously recorded motion capture data to produce a wide variety of desired animation sequences. An animator can upload a custom model of a 3D character and the synthetic motion data generated by the generative model is retargeted to animate the custom 3D character.

Growing community of inventors

El Cerrito, CA, United States of America

Edilson De Aguiar