Disney Enterprises, Inc.

Joseph M Popp

Steven M Chapman

Mehul Patel

Alice J Taylor

Calis O Agyemang

Joseph Hager

Mark Raymond Mine

Steven Tadashi Kosakura

Benjamin F Havey

Alexa L Hale

Michael Paul Goslin

Mark Arana

Jeremie A Papon

Charles P Davis

Dawn J Binder

Todd P Swanson

Ty Popko

Samy Segura

Erika Varis Doggett

James Voris

Matthew Deuel

Jackson A Rogow

Alexandra Christiansen

James Bumgardner

Edwin Rosero

Javier Soto

The disclosure is directed a method including capturing image data of a real-world environment at a first location and a second location different than the first location. The image data includes a plurality of intersecting image data points captured at both the first location and the second location, and a representation of an area occluded by an obstacle from a point of view of a user and; generating a synthesized field of view ('FOV') that includes the plurality of intersecting image data points such that the synthesized FOV includes an unobstructed view of the area occluded by the obstacle from the point of view of the user; and rendering the synthesized FOV as a visual display.

See-through operator awareness tool using synthesized viewpoints

A method to project content from a moving projector. The method includes analyzing an object to identify a projection surface; determining a first position of a projector relative to the projection surface; modifying a first frame of a content for projection onto the projection surface based on the projection surface and the first position of the projector; projecting the first frame of the content from the projector onto the projection surface; determining a second position of the projector relative to the projection surface; modifying a second frame of the content based on the projection surface and the second position; and projecting the second frame of the content from the projector onto the projection surface.

Relative surface travelling map projection process

Systems and methods for compositing real-world video with a virtual object are disclosed. In one embodiment the system includes a processor; and a computer-readable non-transitory storage medium, the medium encoded with instructions that when executed cause the processor to perform operations including receiving video of a video capture region from a camera coupled to an unmanned vehicle; obtaining a map representation of the video capture region; placing the virtual object into the map representation; rendering the video with the virtual object to generate a rendered video; displaying the rendered video; and based on an elevation of the unmanned vehicle, updating the virtual object to transition between a top view of the virtual object and an elevation view or perspective view of the virtual object.

Systems and methods for real-time compositing of video content

An immersive experience system is provided. The immersive experience system has a processor that determines a position of a first head-mounted display. Further, the processor determines a position of a second head-mounted display. The processor also generates a first image for a first immersive experience corresponding to the position of the first head-mounted display. Moreover, the process encodes the first image into a first infrared spectrum illumination having a first wavelength. In addition, the processor generates a second image for a second immersive experience corresponding to the position of the second head-mounted display. Finally, the processor encodes the second image into a second infrared spectrum illumination having a second wavelength. The first wavelength is distinct from the second wavelength.

Illumination-based system for distributing immersive experience content in a multi-user environment

A process generates a certificate of authenticity for a virtual item. Further, the process sends, with the processor, the certificate of authenticity to a decentralized network of computing devices such that two or more of the computing devices store the certificate of authenticity. The two or more of the computing devices receive, from a user device that provides a virtual reality experience in which a virtual item is purchased, a request for authentication of the certificate of authenticity. In addition, the two or more computing devices authenticate the certificate of authenticity based on one or more consistency criteria for the certificate of authenticity being met by the two or more computing devices.

Configuration for authenticating a virtual item

Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include capturing, via a camera, a real-world object in the field of view; generating a first object data associating the real-world object with a first position of the real-world object in a real-world environment at a first time; generating a virtual object representative of the real-world object depicting the real-world object in the first position at the first time; generating a second object data associating the real-world object with a second position of the real-world object in the real-world environment at a second time, determining a displacement value of the real-world object between the first position and the second position, modifying the virtual object to include an indication that the real-world object has been displaced when the displacement value is greater than a threshold value.

Systems and methods for tracking objects in a field of view

A system for providing default content enhanced with supplemental content includes processing hardware and a memory storing a software code. The processing hardware executes the software code to receive a content stream including multiple video frames, a first video frame of the multiple video frames including first default content, first supplemental content, and first encoded metadata, and to decode the first encoded metadata of the first video frame to produce first decoded metadata. The processing hardware further executes the software code to select, using the first decoded metadata, at least a first portion of the first supplemental content for use in enhancing the first default content, transfer, using the first decoded metadata, the selected first portion of the first supplemental content to one or more predetermined locations in the first default content to produce an enhanced first video content, and output the enhanced first video content to a display device.

Content stream having encoded metadata for video enhancement

Systems and methods for providing machine-learning enabled user-specific evaluations are disclosed. Implementations include obtaining a first set of evaluation data from a user interface, obtaining a first set of target-descriptive data including target-specific characteristics objectively describing the evaluation targets, and training, with a machine-learning algorithm, a user-specific evaluation profile indicating evaluation patterns relative to the first set of evaluation data and the first set of target-specific characteristics. Implementations include applying the user-specific evaluation profile to a second set of target-descriptive data to predict a user-specific evaluation.

Machine learning enabled evaluation systems and methods

A system for illuminating a character for a scene includes a computing platform communicatively coupled to a lighting source and a camera, the computing platform including a hardware processor and a system memory storing a software code. The hardware processor executes the software code to identify a background for the scene, generate, using the lighting source, a simulation of the background on a surface illuminated by the lighting source, and utilize the simulation of the background generated on the surface illuminated by the lighting source to illuminate the character for the scene. The hardware processor also executes the software code to track, using the camera, a plurality of parameters of the camera during recording of an image of the illuminated character and the simulation of the background, and to remove the simulation of the background from the image based on the plurality of parameters of the camera.

Realistic illumination of a character for a scene

The disclosure is directed to providing operator visibility through an object that occludes the view of the operator by using a HMD system in communication with one or more imaging devices. A method of doing so may include: using one or more imaging devices coupled to an exterior of an object to capture image data of a real-world environment surrounding the object: calculating an orientation of a HMD positioned in an interior of the object; using at least the calculated orientation of the HMD, synthesizing a FOV of the image data with a FOV of the HMD; and rendering the synthesized FOV of the image data to the HMD. In some instances, the captured image data is used to create a three-dimensional model of the real-world environment, and synthesizing the FOV of the image data includes synthesizing a FOV of the 3D model with the FOV of the HMD.

Systems, devices, and methods are disclosed for compositing real-time, real-world video with virtual objects. An electronic device includes circuitry coupled to a memory storing instructions that, when executed, cause the circuitry to receive video of a given video capture region. The circuitry is caused to receive location information and camera information from the unmanned vehicle. The circuitry is caused to obtain a representation of a location of interest corresponding to the location of the unmanned vehicle. The circuitry is caused to display the representation. The circuitry is caused to obtain virtual objects. The circuitry is caused to place the virtual objects into the representation. The circuitry is caused to render the virtual objects and the video to generate a rendered video including rendered virtual objects in at least one frame of the video. The circuitry is caused to send the rendered video.

An apparatus such as a head-mounted display (HMD) may have a camera for capturing a visual scene for presentation via the HMD. A user of the apparatus may be operating a second, physical camera for capturing video or still images within the visual scene. The HMD may generate an augmented reality (AR) experience by presenting an AR view frustum representative of the actual view frustum of the physical camera. The field of view of the user viewing the captured visual scene via the AR experience is generally larger that the AR view frustum, allowing the user to avoid unnatural tracking movements and/or hunting for subjects.

Augmented reality camera frustum

Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include obtaining, from the non-transient electronic storage, object data. The object data may include a position of one or more objects as a function of time in a field of view. The method may include generating, with the one or more physical computer processors and the one or more AR components, a first virtual object to depict at least one or more of the object data of a first object at a first time. The method may include displaying, via the display, the first virtual object.

The disclosure is directed toward stabilizing an image projected by a projector in an environment including vibrations or other movements that displace the projected image. In one set of implementations, an image projected by a projector may be stabilized by using an image stabilization system that detects a displacement of the projector from an equilibrium position and controls an optical element of the projector to offset the displacement. In an additional set of implementations, an image projected by the projector may be stabilized by using an image stabilization system that measures a rate of displacement from equilibrium of an image projected by the projector to predict a displacement of the projector and counteract the predicted displacement. In another set of implementations, an image projected by a projector may be stabilized by precalculating a plurality of lookup tables that correct for displacements of the projected image during operation of the projector.

Growing community of inventors

Cerritos, CA, United States of America

Joseph M Popp