Pixar

Pullstring, Inc.

Toytalk, Inc.

Chatterbox Capital LLC

Pixar Animation Studio

Oren M Jacob

Robert Jensen

Eric Gregory

Martin Reddy

Michael S Ferris

Timothy S Milliron

Warren Trezevant

Robert G Podesta

Lucas R A Ives

Brendan Donohoe

Kathleen Hale

Michael Chann

Jon Collins

Benjamin Morse

Akhil Jiten Madhani

David DiFrancesco

Loren C Carpenter

Alexis Paul Wieland

Mike Ferris

Murat N Konar

Brad Andalman

Wilson Taylor Holliday

Andrew Justin Butts

Lucas R Ives

Brian Langner

Systems and methods for both technical and non-technical users to create content for interactive synthetic characters are provided. In some embodiments, a conversation editor may be configured to create a traversable script for an interactive synthetic character by receiving a set of conversation rules from a user. These rules can be used to match certain words or phrases that a user speaks or types, or to monitor for a physical movement of the user or synthetic character. Each conversation rule can include responses to be performed by the interactive synthetic character. The responses can include, for example, producing audible or textual speech for the synthetic character, performing one or more animations, playing one or more sound effects, retrieving data from one or more data sources, and the like. A traversable script can be generated from the set of conversation rules that when executed by the synthetic character allows for the dynamic interactions. In some embodiments, the traversable script can be navigated by a state engine using one or more navigational directives associated with the conversation rules.

Artificial intelligence script tool

Systems and methods to create content for interactive synthetic characters are provided. In some embodiments, a conversation editor may be configured to create a traversable script for an interactive synthetic character by receiving conversation rules from a user. These rules can be used to match words or phrases that a user speaks or types, or to monitor for a physical movement of the user or synthetic character. Each rule can include responses to be performed by the interactive synthetic character. Examples of responses include producing audible or textual speech for the synthetic character, performing animations, playing sound effects, retrieving data, and the like. A traversable script can be generated from the conversation rules that when executed by the synthetic character allows for the dynamic interactions. In some embodiments, the traversable script can be navigated by a state engine using navigational directives associated with the conversation rules.

Various of the disclosed embodiments relate to systems and methods for providing animated multimedia, e.g. animated shows, to an audience over a network. Particularly, some embodiments provide systems and methods for generating and providing audio, animation, and other experience-related information so that user's may readily experience the content in a seamless manner (e.g., as an audience member watching a show, playing a video game, etc.). Various embodiments animate 'to the audience' based, e.g., on what content the audience is consuming. The animations may be generated in real-time from constituent components and assets in response to user behavior.

Multi-character authoring interface for large scale animations

Run-time techniques for playing large-scale cloud-based animations

Various of the disclosed embodiments relate to systems and methods for extracting audio information, e.g. a textual description of speech, from a speech recording while retaining the anonymity of the speaker. In certain embodiments, a third party may perform various aspects of the anonymization and speech processing. Certain embodiments facilitate anonymization in compliance with various legislative requirements even when third parties are involved.

Feature extraction for anonymized speech recognition

A method allowing for quick manipulation of weight values associated with points on a polygonal mesh that is to be deformed. A point on the polygonal mesh may be selected by the user. Then, a solution space of possible positions for the selected point may be calculated by solving a deformation model for a range of weight values. A graphical representation of the solution space may be provided, such as a locus of possible positions for the selected point, where each point on the locus corresponds to a particular weight value. Manipulation of these weight values, and hence, the deformation of the polygonal mesh, may be achieved simply by selecting a position on the locus. The mesh may be updated to reflect the weight corresponding to the selected position.

Graphical user interface for performing deformations

Systems and methods for modifying content for interactive synthetic characters are provided. In some embodiments, a traversable script for an interactive synthetic character may be modified based on analytics relating to the use of the interactive synthetic character (e.g. words spoken by the user, language spoken, user demographics, length of interactions, visually detected objects, current environmental conditions, or location). The traversable script may include conversation rules that include actions to be performed by the interactive synthetic character. The actions can include, for example, producing audible or textual speech, performing animations, playing sound effects, retrieving data from data sources, and the like. The traversable script can be modified, customized, or improved based on the feedback from the use of the character by a plurality of users. The modifications may happen automatically or be reviewed by a content creator using a graphical user interface.

Systems and methods for artificial intelligence script modification

A device/system and method for creating customized audio segments related to an object of interest are disclosed. The device and/or system can create an additional level of interaction with the object of interest by creating customized audio segments based on the identity of the object of interest and/or the user's interaction with the object of interest. Thus, the mobile device can create an interactive environment for a user interacting with an otherwise inanimate object.

Customized audio content relating to an object of interest

Empty elements or positions in an arrangement of data are hidden or revealed to present an overview of the relationships between empty and non-empty elements. Empty elements may be revealed at fractional increments of the interval between the two items. Additional empty elements may be revealed at smaller fractional increments of the intervals. Empty elements may be revealed at fixed increments within the interval between two items, with additional empty elements revealed at further multiples of this increment. Hierarchical arrangements of data may be unfolded or expanded to reveal additional empty or non-empty elements at further hierarchy levels. Similarly, nodes of arbitrary graphs that are empty, associated with a specified hierarchy level, and/or satisfy any other criteria may be automatically hidden and grouped with visible items. Hidden data may be revealed based on hierarchy level or a relative position with respect to one, two, or more visible items.

Unfolding sparse data sets

A user interface presents views of entities and their attributes relative to any subset of associated parameters. A view may present views of entities as a function of one or more parameters. A selection of a subset of entities in one view with respect to parameters may be presented in another view with respect to different parameters. Entities may be manipulated in any supplemental view to change their values or their parameter associations. A view may present components and parameters associated with layers or any subset of layers and/or after layer compositing. A view can include resolved values of components and their attributes. A supplemental view may include visual indicators to indicate the layer or other parameter defining its resolved value. Hierarchical relationships may be presented in views, with ancestor entities expanded within a view to show its descendent entities or collapsed to hide its descendent entities.

Visualization of value resolution for multidimensional parameterized data

A method for specifying an animatronics unit includes receiving a force-based software model for the animatronics unit, receiving a kinematics-based software model for the animatronics unit, receiving animation data for animating the kinematics-based software model, wherein the animation data comprises artistically determined motions for the kinematics-based software model by a user, determining a plurality of driving signals in response to the animation data, animating the force-based software model of the animatronics unit in response to the plurality of driving signals, displaying animation of the force-based software model determined in response to the plurality of driving signals, and determining a specification for construction of the animatronics unit in response to animation of the force-based software model.

Animatronics animation method and apparatus

Multiple time scales enable animations over multiple shots. Time-dependent data is specified with reference to time references. Data expressed in different time references may be combined to form animations, shots, and sequences of shots. Time transformations specifying mappings between time references are used to combine data expressed in different time references. Data can be viewed in arbitrary time references. Editing data specifying a sequence of shots may be used as a time reference for viewing data expressed in other time references. Data expressed in one time reference may be rearranged according to another time reference to indicate time reference relationships. Data authored in one time reference may be viewed and modified in another time reference. Modifications are converted from the viewing time reference to the data's original time reference for updating data. Time-dependent data may be expressed in layer data structures. Layer relationships may include time transformations.

Multiple time scales in computer graphics

Animation software enables the creation and manipulation of animation in terms of relationships between poses, as opposed to discrete values of computer graphics variable knots. Poses are automatically associated with animation structures that define object pose or poses over a time interval, rather than at a single discrete time. Animation structures may define and manipulate animation data defined over time intervals as a unit, as opposed to a set of unrelated computer graphics variable knots. Animation structures may be used to block out the general form, timing, and rhythm of animations. Optional transition animation structures, pose anticipations, and pose reactions may be automatically or manually defined between adjacent pose hold durations. General parameters of an animation structure may be applied to create or modify the animation data associated with the animation structure. Operations on animation structures can be applied to all of the animation data included in these animation structures.

Pose-structured animation interface

To assist users in identifying the contributions of specific computer graphics variable or animation variable knots to the timing, rhythm, and expression of complicated animations, an animation software interface includes a snapsheet mode for visualizing and authored poses of objects. The snapsheet mode presents a series of rendered still images corresponding with the authored poses of one or more selected entities. The snapsheet mode may use one or more computer graphics variables, one or more objects, or arbitrary frames or shot time values as selected entities. The snapsheet mode associates each still image with a portion of the shot time of the overall animation corresponding with the selected entity's influence in the animation. Users may modify animation data via the snapsheet mode using each image may act as a proxy for manipulating associated authored values of one or more computer graphics variables.

Growing community of inventors

Piedmont, CA, United States of America

Oren M Jacob