Katrix, Inc.

University of Pennsylvania

Sovoz, Inc.

Stephen H Lane

David A Handelman

Vijaykumar Gullapalli

Liming Zhao

Aline Sarah Normoyle

Yaoyi Bai

Joseph Schnurr

Ji Hyun Kong

Hemanth K Satyanarayana

Matthew Anthony Boyd-Surka

Methods, systems, and computer readable media for providing an extended reality (XR) user interface. A method for providing an XR user interface occurs at a user device executing an XR application. The method comprises: receiving content information about a hierarchical container structure; obtaining, via the XR application, spatial information about a physical and/or virtual environment; generating, using the content information, at least one immersive visual element for visually representing the hierarchical container structure, wherein each of the at least one immersive visual element represents a container, a sub-container, or a data element of the hierarchical container structure; and providing, using the XR application, the spatial information, and a display, the at least one immersive visual element by augmenting a depiction of the physical and/or virtual environment so that a user can enter the at least one immersive visual element, access elements of the hierarchical container structure from within the at least one immersive visual element, and view the physical and/or virtual environment through the at least one immersive visual element.

Methods, systems, and computer readable media for extended reality user interface

Methods, systems, and computer readable media for receiving user input. According to one example method for receiving user input, the method includes identifying gestures from directional movements of a user's fingers on a touch sensor, mapping the gestures to alphanumeric characters, and outputting alphanumeric characters, including defining a set of the gestures as different sequences of at least two of: a contact event, a no contact event, a hold event, a finger movement in a first direction, a finger movement in a second direction.

User interface input method and system for handheld and mobile devices

Apparatus and methods are disclosed for a virtual locomotion controller user interface and system that combines data obtained from various sensor devices to allow users to control the movements of their representation in a virtual world using sensorimotor responses closely resembling the tasks and actions they would physically perform in the real world. As a result, users can specify an avatar's locomotion style by assuming body postures normally associated with that type of movement, while controlling locomotion speed or displacement through foot forces and/or stepping motions and locomotion direction through foot and body orientation.

Virtual locomotion controller apparatus and methods

A method and apparatus for interactively controlling and coordinating the limb movements of computer-generated articulated characters with an arbitrary number of joints. On-line computational methods are used for animating limb movements of articulated characters by solving associated forward and inverse kinematics problems in real time subject to multiple goals and constraints. The methods provide computer animated characters with fully interactive goal-directed behaviors, such as bipedal walking, through simultaneous satisfaction of position, alignment, posture, balance, obstacle avoidance, and joint limitation constraints. Goal-based motion primitives, called synergies, coordinate sets of joint movements which separately attempt to satisfy each of the above constraints. The present methods adapt character movements on-line to accommodate uneven terrain, body modifications, or changes in the environment by automatically transforming and producing joint rotations relative to the instantaneous point of contact of the body with the world. Libraries of pre-configured goal-directed behaviors, such as reaching, sitting, walking, jumping, etc., can be constructed and used to animate a wide variety of characters.

Limb coordination system for interactive computer animation of articulated characters

Recorded motion data is combined with interactive control techniques to manipulate the animation of articulated figures. The methods enable computer animated characters to produce fully interactive goal-directed behaviors, such as bipedal walking, through simultaneous satisfaction of position, alignment, posture, balance, obstacle avoidance, and joint limitation constraints while retaining qualitative characteristics of the original non-interactive motion data. Goal-based motion primitives, called synergies, are used to coordinate sets of joint movements that attempt to satisfy each of the above constraints. Non-interactive motion capture and keyframe data, representing examples of desired character movements, are accommodated in the present animation system in three ways: 1) direct approach--non-interactive motion data used directly to specify desired body posture synergy goals as a function of time, 2) hybrid approach--non-interactive motion data and program control commands blended to specify elements of desired position, alignment and/or balance synergy goals as a function of time, and 3) template approach--non-interactive motion data used to auto-tune adjustable parameters, enabling program control commands to generate fully interactive movements that qualitatively resemble the non-interactive motion data. The disclosed methods allow libraries of pre-configured goal-directed behaviors, such as reaching, sitting, walking, jumping, etc., to be constructed and used to animate a wide variety of characters.

Interactive motion data animation system

A method and apparatus for interactively controlling and coordinating the limb movements of computer-generated articulated. On-line computational methods are used for animating limb movements of articulated characters by solving associated forward and inverse kinematics problems in real time subject to multiple goals and constraints. The methods fully interactive goal-directed behaviors, such as bipedal walking, through simultaneous satisfaction of position, alignment, posture, balance, obstacle avoidance, and joint limitation constraints. Goal-based motion primitives, called synergies, coordinate sets of joint movements which separately attempt to satisfy each of the above constraints. The present methods adapt character movements on-line to accommodate uneven terrain, body modifications, or changes in the environment by automatically transforming and producing joint rotations relative to the instantaneous point of contact of the body with the world. Recorded motion data is combined with interactive control techniques to manipulate the animation of articulated figures. The methods enable computer animated characters to produce fully interactive goal-directed behaviors, while retaining qualitative characteristics of the original non-interactive motion data. Non-interactive motion capture and keyframe data, representing examples of desired character movements, are accommodated in the present animation system in three ways: 1) direct approach--non-interactive motion data used directly to specify desired body posture synergy goals as a function of time, 2) hybrid approach--non-interactive motion data and program control commands blended to specify elements of desired position, alignment and/or balance synergy goals as a function of time, and 3) template approach--non-interactive motion data used to auto-tune adjustable parameters, enabling program control commands to generate fully interactive movements that qualitatively resemble the non-interactive motion data.

Growing community of inventors

Princeton, NJ, United States of America

Stephen H Lane