Disney Enterprises, Inc.

Mark Raymond Mine

Steven M Chapman

Evan Goldberg

Dane M Coffey

Daniel L Baker

Matthew Deuel

Joseph M Popp

Calis O Agyemang

Alexa L Hale

David Crawford

Alice J Taylor

Siroberto Scerbo

Dawn J Binder

Christopher Richard Schroers

Edward Allen Nemeth

Erika Varis Doggett

Asa K Kalama

Thomas Fraiser LaDuke

Andrew M Ogden

Christopher Raynard Runco

Bei Yang

Jason M Lambert

Charita Y Carter

Modupe Adeleye

Tracking an item of interest through an environment is described. Tracking the item of interest through the environment is accomplished using passive optical tracking where an item is identified in an image of the environment using image processing and various locations of the item are tracked through the environment. When a user wants to know an item's location, a location image is projected onto the location of the item to allow a user view a current location of the item.

Item location tracking via image analysis and projection

An image processing system includes a computing platform having processing hardware, a display, and a system memory storing a software code. The processing hardware is configured to execute the software code to receive a three-dimensional (3D) digital model, surround the 3D digital model with multiple virtual cameras oriented toward the 3D digital model, and generate, using the virtual cameras, a multiple renders of the 3D digital model. The processing hardware is further configured to execute the software code to generate a UV texture coordinate space for a surface projection of the 3D digital model, and to transfer, using the multiple renders, lighting color values for each of multiple surface portions of the 3D digital model to the UV texture coordinate space.

3D digital model surface rendering and conversion

In one implementation, an enhanced vision system includes a portable user device, a base station including a hardware processor and a memory storing a virtual effects rendering software code, and a display device communicatively coupled to the base station. The hardware processor executes the virtual effects rendering software code to detect the presence of the portable user device in a real-world environment, obtain a mapping of the real-world environment, and identify one or more virtual effect(s) for display in the real-world environment. The hardware processor further executes the virtual effects rendering software code to detect actuation of the portable user device, and to control the display device to display the virtual effect(s) in the real-world environment based on the mapping, and the position and orientation of the portable user device during the detected actuation.

Enhanced vision system and method

An image processing system includes a computing platform having processing hardware, a display, and a system memory storing a software code. The processing hardware executes the software code to receive a digital object, surround the digital object with virtual cameras oriented toward the digital object, render, using each one of the virtual cameras, a depth map identifying a distance of that one of the virtual cameras from the digital object, and generate, using the depth map, a volumetric perspective of the digital object from a perspective of that one of the virtual cameras, resulting in multiple volumetric perspectives of the digital object. The processing hardware further executes the software code to merge the multiple volumetric perspectives of the digital object to form a volumetric representation of the digital object, and to convert the volumetric representation of the digital object to a renderable form.

Volumetric representation of digital objects from depth renderings

Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include capturing, via a camera, a real-world object in the field of view; generating a first object data associating the real-world object with a first position of the real-world object in a real-world environment at a first time; generating a virtual object representative of the real-world object depicting the real-world object in the first position at the first time; generating a second object data associating the real-world object with a second position of the real-world object in the real-world environment at a second time, determining a displacement value of the real-world object between the first position and the second position, modifying the virtual object to include an indication that the real-world object has been displaced when the displacement value is greater than a threshold value.

Systems and methods for tracking objects in a field of view

In one implementation, a virtual-world simulator includes a computing platform having a hardware processor and a memory storing a software code, a tracking system communicatively coupled to the computing platform, and a projection device communicatively coupled to the computing platform. The hardware processor is configured to execute the software code to obtain a map of a geometry of a real-world venue including the virtual-world simulator, to identify one or more virtual effects for display in the real-world venue, and to use the tracking system to track a moving perspective of one of a user in the real-world venue or a camera in the real-world venue. The hardware processor is further configured to execute the software code to control the projection device to simulate a virtual-world by conforming the identified one or more virtual effects to the geometry of the real-world venue from a present vantage point of the tracked moving perspective.

Virtual-world simulator

The present disclosure describes a method for displaying supplemental content. The method includes determining environmental characteristics, e.g., wall space, empty areas, colors, etc., for a display environment, determining supplemental content based in part on a primary content displayed by a primary display, and displaying the supplemental content in the display environment.

Display of supplemental content

Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include obtaining, from the non-transient electronic storage, object data. The object data may include a position of one or more objects as a function of time in a field of view. The method may include generating, with the one or more physical computer processors and the one or more AR components, a first virtual object to depict at least one or more of the object data of a first object at a first time. The method may include displaying, via the display, the first virtual object.

Systems and methods for displaying object features via an AR device are disclosed. The method may include receiving, from a transmitter, a signal from an object on a movie set. The signal may specify object data. The object may be a prop. The object data may specify one or more features corresponding to the prop. The method may include generating, with the one or more physical computer processors and the one or more AR components, a representation of the one or more features using visual effects to depict at least some of the object data. The method may include displaying, via the AR device, the representation onto a view of the prop.

Systems and methods for displaying object features via an AR device

A process determines, with a processor, a virtual indicium position in a physical environment at which a virtual indicium is to be projected. The processor determines the virtual indicium position based on a point of intersection of a vector and an object within the physical environment. The vector originates at a head position of a user and is directed through a point of intended gaze on a virtual object toward the virtual indicium. Further, the processor sends, with the processor to an actuator, an instruction to adjust a position of a projector in operable communication with the actuator so that the projector projects the virtual indicium toward the virtual indicium position.

Virtual indicium display system for gaze direction in an image capture environment

An apparatus for supporting a hand-operated input device on a hand. The apparatus includes a first mounting member with a hoop-shaped body and a second mounting member with a semi-circular shaped body. At first and second ends, the second mounting member is rigidly coupled at spaced-apart first and second locations to the first mounting member. A device support is rigidly coupled to the first mounting member, and the device support is adapted for supporting a hand-operated input device. The first mounting member contacts the hand at first and second contact points, and the second mounting member contacts the hand at a third contact point. The first and second contact points are located on opposite sides of the hand between the knuckles and the heel of the hand, and the third contact point is on an opposite side of the hand from the first contact point and proximate to the heel.

Lightweight system for mounting hand-operated tools, objects, and interaction devices to a user's hand

There is provided an interactive device capable of providing input data to a computer program in response to user interactions, the interface device comprising a first position sensor reading a sensed location of the interface device having a free roaming movement in a three-dimensional space, a direction vector determination device determining a direction vector indicating an aiming direction, and a transmission system communicating aim information to an external device implementing the computer program. The transmission system may include a transmitter for the direction vector and/or a transmitter for the sensed location. The computer program can use the aim information and input data to support a projected 3D game environment or other application providing sensory feedback in response to the user interactions. Multiple interactive devices having unique identifiers may also be supported. The interactive device enables significant freedom to roam relative to implementing equipment, as compared to existing interactive devices having only a limited range of movement relative to implementing equipment.

System and method for providing user interaction with projected three-dimensional environments

A system is provided for visually enhancing a game structure having a game surface and objects that move on the game surface. The system includes a projector that projects digital augmentation content or themed images onto the game surface, with the images including static and animated images. The system includes a tracking mechanism that generates tracking data from the game surface and game objects, with the tracking data defining positions of the game objects relative to the game surface. The system includes a controller that processes the tracking data to determine the positions of the game objects. The controller modifies the augmentation images in response to the determined positions of the game objects. The augmentation images include a video stream made up of a base image that is mapped to the game surface and an object enhancing image mapped to one of the game objects and its current position.

Entertainment system providing dynamically augmented game surfaces for interactive fun and learning

A method for digitally augmenting or enhancing a food product such as the surface or top of a cake or other edible object. The method includes generating an augmentation media file based on a projection surface of the food product such as a digital movie or image that is mapped to the 3D topography of projection surface and that is projected on the food product using a properly aligned projector. Interactivity is provided by having the method include determining a modification or change of the 3D topography of the projection surface and, based upon the modification, generating a modified augmentation media file and operating the projector to use the modified augmentation media file to project a modified projected image on the food product. The method further provides interactivity by detecting a user interaction with the projection surface and generating a modified augmentation media file based on this tracked interaction.

Growing community of inventors

Canyon Country, CA, United States of America

Mark Raymond Mine