Verizon Patent and Licensing Inc.

William Patrick Gervasio

Denny Breitenfeld

Oliver S Castaneda

A virtual object and a virtual vantage point are included within a three-dimensional space. An exemplary virtual scene capture system generates a key description frame representative of a state of the virtual object and a state of the virtual vantage point at a first point in a temporal sequence. The virtual scene capture system also generates an update description frame that represents the state of the virtual object and not the state of the virtual vantage point at a second point in the temporal sequence. The virtual scene capture system provides the key description frame and the update description frame to a three-dimensional rendering engine server. The rendering engine server is configured to render, based on the key and update description frames, surface data frames depicting the virtual object from the virtual vantage point. Corresponding methods and systems are also disclosed.

Methods and systems for rendering frames based on virtual entity description frames

An exemplary virtual scene capture system maintains state data for a virtual object and a virtual vantage point that are both included within a virtual 3D space of a virtual scene. Based on the state data, the capture system generates a virtual entity description frame representative of a state of the virtual object and/or the virtual vantage point. The virtual entity description frame includes a link to color data representative of the virtual object and stored in an asset storage system associated with the capture system. The capture system provides the virtual entity description frame to a 3D rendering engine associated with the virtual vantage point and configured to render, based on state data represented in the virtual entity description frame and color data for the virtual object and accessed from the asset storage system using the link, a color data frame associated with the virtual vantage point.

Methods and systems for rendering frames based on a virtual entity description frame of a virtual scene

An exemplary merged reality scene capture system ('system') generates a transport stream based on video data received from a plurality of capture devices. The transport stream includes a respective video data stream for each capture device, each respective video data stream representing surfaces of a real-world object as the surfaces appear from a vantage point of the capture device. Based on the transport stream, the system generates entity description data representative of the real-world object. The system also generates entity description data representative of a virtual object to be included within a 3D space of a merged reality scene along with the real-world object. Based on the entity description data, the system generates an entity description frame representative of a state of the objects within the 3D space. The system provides the entity description frame to a plurality of 3D rendering engines associated with a content provider system.

Methods and systems for generating a merged reality scene based on a real-world object and a virtual object

An exemplary virtual scene capture system ('system') maintains data representative of a plurality of virtual entities included within a virtual 3D space of a virtual scene. The plurality of virtual entities includes a virtual object and a plurality of virtual vantage points into the virtual 3D space. Based on the maintained data, the system generates a virtual entity description frame representative of a state of at least one of the virtual entities at a particular point in a temporal sequence. The system then provides the virtual entity description frame to a plurality of server-side 3D rendering engines corresponding to different vantage points in the plurality of virtual vantage points and configured to render, based on the virtual entity description frame, surface data frames representative of color and depth data of surfaces of the virtual object visible from the different virtual vantage points at the particular point in the temporal sequence.

Methods and systems for rendering frames of a virtual scene from different vantage points based on a virtual entity description frame of the virtual scene

An exemplary merged reality scene capture system ('system') receives a first frame set of surface data frames from a plurality of three-dimensional ('3D') capture devices disposed with respect to a real-world scene so as to have a plurality of different vantage points of the real-world scene. Based on the first frame set, the system generates a transport stream that includes color and depth video data streams for each of the 3D capture devices. Based on the transport stream, the system generates entity description data representative of a plurality of entities included within a 3D space of a merged reality scene. The plurality of entities includes a virtual object, the real-world object, and virtual viewpoints into the 3D space from which a second frame set of surface data frames are to be rendered representing color and depth data for both the virtual and the real-world objects.

Methods and systems for generating a merged reality scene based on a virtual object and on a real-world object represented from different vantage points in different video data streams

Growing community of inventors

Liberty Corner, NJ, United States of America

William Patrick Gervasio