Soul Machines Limited

Sony Interactive Entertainment America LLC

Sony Corporation

Sony Interactive Entertainment Inc.

Sony Pictures Entertainment, Inc.

Mark Andrew Sagar

Tim Szu-Hsien Wu

Homoud B Alkouh

David Peter Bullivant

Colin Joseph Hodges

Frank Filipe Bonniwell

Paul Burton Robertson

Xiani Tan

Parag Havaldar

Josh Ochoa

Xueyuan Zhang

Werner Ollewagen

Robert Jason Munro

Shane Allan Blackett

To realistically animate a String (such as a sentence) a hierarchical search algorithm is provided to search for stored examples (Animation Snippets) of sub-strings of the String, in decreasing order of sub-string length, and concatenate retrieved sub-strings to complete the String of speech animation. In one embodiment, real-time generation of speech animation uses model visemes to predict the animation sequences at onsets of visemes and a look-up table based (data-driven) algorithm to predict the dynamics at transitions of visemes. Specifically posed Model Visemes may be blended with speech animation generated using another method at corresponding time points in the animation when the visemes are to be expressed. An Output Weighting Function is used to map Speech input and Expression input into Muscle-Based Descriptor weightings.

Real-time generation of speech animation

Interaction with a Computer is provided via an autonomous virtual embodied Agent. The Computer outputs Digital Content, which includes any content that exists in the form of digital data and is representable to a User. A subset of, or all, Digital Content is configured as Shared Digital Content which is representable to both the User and to the Agent.

Machine interaction

Systems and methods for image retargeting are provided. Image data may be acquired that includes motion capture data indicative of motion of a plurality of markers disposed on a surface of a first subject. Each of the markers may be associated with a respective location on the first subject. A plurality of blendshapes may be calculated for the motion capture data based on a configuration of the markers. An error function may be identified for the plurality of blendshapes, and it may be determined that the plurality of blendshapes can be used to retarget a second subject based on the error function. The plurality of blendshapes may then be applied to a second subject to generate a new animation.

Image regularization and retargeting system

The present invention relates to a computer implemented system for animating a virtual object or digital entity. It has particular relevance to animation using biologically based models, or behavioural models particularly neurobehavioural models. There is provided a plurality of modules having a computational element and a graphical element. The modules are arranged in a required structure and have at least one variable and being associated with at least one connector. The connectors link variables between modules across the structure, and the modules together provide a neurobehavioural model. There is also provided a method of controlling a digital entity in response to an external stimulus.

System for neurobehaviorual animation

System for neurobehavioural animation

A method for creating a model of a virtual object or digital entity is described, the method comprising receiving a plurality of basic shapes for a plurality of models; receiving a plurality of specified modification variables specifying a modification to be made to the basic shapes; and applying the specified modification(s) to the plurality of basic shapes to generate a plurality of modified basic shapes for at least one model.

Digital character blending and generation system and method

The present invention relates to a computer implemented system for animating a virtual object or digital entity. It has particular relevance to animation using biologically based models, or behavioral models particularly neurobehavioral models. There is provided a plurality of modules having a computational element and a graphical element. The modules are arranged in a required structure and have at least one variable and being associated with at least one connector. The connectors link variables between modules across the structure, and the modules together provide a neurobehavioral model. There is also provided a method of controlling a digital entity in response to an external stimulus.

A method of animating a digital facial model, the method including: defining a plurality of action units; calibrating each action unit of the plurality of action units via an actor's performance; capturing first facial pose data; determining a plurality of weights, each weight of the plurality of weights uniquely corresponding to the each action unit, the plurality of weights characterizing a weighted combination of the plurality of action units, the weighted combination approximating the first facial pose data; generating a weighted activation by combining the results of applying the each weight to the each action unit; applying the weighted activation to the digital facial model; and recalibrating at least one action unit of the plurality of action units using input user adjustments to the weighted activation.

Growing community of inventors

Auckland, New Zealand

Mark Andrew Sagar