Mursion, Inc.

University of Central Florida Research Foundation, Inc.

University of Florida Research Foundation, Incorporated

Arjun Nagendran

Brian D Kelly

Gregory Francis Welch

Laura Gonzalez

Kelly Allred

Karen Aroian

Patricia Weinstein

Remo Pillat

Alex Zelenin

Steven Talbert

Charles E Hughes

Michael C Hynes

Lisa A Dieker

Hassan Foroosh

Jason Eric Hochreiter

Scott Compton

Mary Lou Sole

William C Follette

A peer to peer communication system and method are provided to enable interfacing with an application running on a gaming engine for an avatar simulation or video conference. The system and method establish a real-time peer-to-peer communication link between remotely located users for transmission in real-time of audio, video, and data communications. The system and method capture incoming audio and video transmissions from input devices operable by the users while controlling one or more avatars, and transmit, in real time, synchronized audio, video, and data communications to the users over the communication link.

Peer to peer communication system and method

Aspects of systems and methods for collaborating physical-virtual interfaces are disclosed. In an example, a method may include transmitting digital content to display in a virtual environment that includes one or more human inhabited characters, the digital content corresponding to content displayed on one or more interactive devices. The method may also include receiving first input data representing content markup of the digital content from a first user of the first interactive device. The method may also include determining an action state or an appearance state for a human inhabited character in response to the first data. The method may also include transmitting the first input data to display in the virtual environment and transmitting the human inhabited character to display in the virtual environment according to the action state or the appearance state.

Systems and methods for collaborating physical-virtual interfaces

Systems and methods for automated control of human inhabited characters. In an example, control of human inhabited character may be achieved via a plurality of input devices, including, but not limited to, a microphone, a camera, or a hand-held controller, that can modify and trigger changes in the appearance and/or the behavioral response of a character during the live interactions with humans. In an example, a computing device may include a neural network that receives the input from the microphone and/or the camera and changes the appearance and/or the behavioral response of the character according to the input. Further, input from the hand-held controller may be used to adjust a mood of the character or, in other words, emphasize or deemphasize the changes to the appearance and/or the behavioral response of the character.

Systems and methods for automated control of human inhabited characters

A rating interface system and method are provided that allow human users to continuously rate the impact they or other human users and/or their avatars are having on themselves or others during interpersonal interactions, such as conversations or group discussions. The system and method provide time stamping of users' ratings data and audio and video data of an interaction, and correlate the ratings data with the audio and video data at selected time intervals for subsequent analysis.

Rating interface for behavioral impact assessment during interpersonal interactions

A control system provides an interface for virtual characters, or avatars, during live avatar-human interactions. A human interactor can select facial expressions, poses, and behaviors of the virtual character using an input device mapped to menus on a display device.

Control system for virtual characters

A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from behind to provide one or more dynamic images viewable on the outer surface of the shells; a support system adapted to receive the shells via a mounting system, wherein the system comprises one or more image units adapted to render the one or more dynamic images viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training.

Physical-virtual patient bed system

A system and method for controlling a humanoid robot from a remote location are provided. One or more sensing devices are used to sense positions and movements of a user at an inhabiter station. A computing device generates a virtual character based upon the sensed positions and movements of the user and provides a plurality of outputs for controlling the humanoid robot based upon motion of the virtual character. The computing device includes a master controller to generate the virtual character and its behaviors and to transmit instructions to control motion of the humanoid robot to a slave controller located at the humanoid robot, providing smooth and natural motion of the humanoid robot. The method permits switching between multiple virtual characters in a single scene to control and alter the behavior of one or more humanoid robots located in several geographic locations.

Control interface for robotic humanoid avatar system and related methods

A system is for monitoring a sterile field associated with a medical procedure. The system may include a sensor being adjacent an area where the medical procedure is to be performed. The sensor is configured to monitor at least the area, a patient for the medical procedure, and a medical technician for the medical procedure. The system may include a processor coupled to the sensor and configured to detect a sterile field event, and an associated location for the sterile field event, and an output device coupled to the processor and configured to generate an alert indicator when the sterile field event is detected, the alert indicator also including the associated location.

System for detecting sterile field events and related methods

A low-cost, low-demand (physical and cognitive) interface for puppeteers that allows them to easily participate in the control of verbal and non-verbal activities of a set of virtual characters or avatars. The invention further provides a low-cost, unencumbered interface for participants that allows them to employ both natural movement and also verbal and non-verbal interaction with virtual characters. A network protocol supports real-time remote interaction even when dealing with relatively poor network connections; and an integrated after-action review system supports trainers in the processes of tagging and commenting on events, subsequently using these to assist reflection on the part of participants.

Growing community of inventors

Orlando, FL, United States of America

Arjun Nagendran