Verizon Patent and Licensing Inc.

Oliver S Castaneda

Denny Breitenfeld

Michael Lodato

William Robert Davey

William Patrick Gervasio

Joshua Shadik

Vito Joseph Messina

Mohammad Raheel Khalid

Vidhya Seran

Dan Sun

Pai Moodlagiri

Liang Luo

Rene Sepulveda

Nazneen Khan

Bradley G Anderegg

Scott David Brown

Carl L Keifer, Iii

Samuel Charles Mindlin

James Susinno

Zhiguang Eric Zhang

An illustrative interactive content provider system transmits a live video stream to an interactive content player device, and, during the transmitting of the live video stream, provides an executable data object to the interactive content player device. The executable data object includes an interactive content instance configured to be presented within a 3D virtual playing area that bounds at least one virtual object of the interactive content instance. The interactive content provider system directs the interactive content player device to execute the executable data object by overlaying the 3D virtual playing area of the interactive content instance onto a presentation of the live video stream. Corresponding methods and systems are disclosed for both the interactive content provider system and the interactive content player device.

Methods and systems for interactive content delivery in connection with a live video stream

An illustrative server system receives a request from a client device to join a virtual world managed by the server system. In response to receiving the request, the server system identifies an avatar location for an avatar that is to represent a user of the client device within the virtual world when the client device joins the virtual world. Based on the avatar location, the server system determines a first priority value for a first asset of the virtual world and a second priority value for a second asset of the virtual world. Based on the first and second priority values, the server system provides to the client device a prioritized replication of the virtual world in which the first asset is replicated in a prioritized manner that allows the user to experience the first asset before the second asset is replicated. Corresponding methods and systems are also disclosed.

Methods and systems for prioritized replication of a virtual world

Illustrative methods and systems described herein use lightmaps to present 3D graphics. For example, a method includes identifying a viewpoint within a 3D scene and receiving a dynamic lightmap for an object represented by a 3D model in the 3D scene. The identified viewpoint is selected by a user of a media player device presenting the 3D scene to the user and the dynamic lightmap is generated or updated at a first level of detail determined based on the identified viewpoint. The method further includes rendering an image for presentation to the user from the identified viewpoint. This rendering of the image includes rendering the 3D model at a second level of detail that is lower than the first level of detail, and applying the dynamic lightmap at the first level of detail to the 3D model rendered at the second level of detail. Corresponding systems are also disclosed.

Methods and systems for using dynamic lightmaps to present 3D graphics

An illustrative computing system is configured to perform volumetric reconstruction based on a confidence field. In one implementation, the computing system accesses color and depth data captured from a plurality of different vantage points for a surface point on a surface of an object. Based on the color and depth data captured from the plurality of different vantage points, the computing system determines a confidence field value associated with the surface point. Based on the confidence field value associated with the surface point, the computing system generates reconstructed color and depth data for a volumetric reconstruction of the surface of the object. Corresponding methods and systems are also disclosed.

Methods and systems for volumetric reconstruction based on a confidence field

An exemplary object modeling system determines a set of directional occlusion values associated with a surface point on a surface of a virtual object. The directional occlusion values are representative of an exposure of the surface point to ambient light from each direction of a set of directions defined by a radiosity basis. The object modeling system also stores the set of directional occlusion values as part of texture data defining the surface point and provides the texture data that includes the set of stored directional occlusion values associated with the surface point. Corresponding methods and systems are also disclosed.

Methods and systems for using directional occlusion shading for a virtual object model

An illustrative interactive content delivery system includes an interactive content player device (player device) and an interactive content provider system (provider system). As the provider system transmits a live video stream to the player device, the player device detects a first event marker in the live video stream, accesses an executable data object including data representative of an interactive content instance, and executes, based on the executable data object, the interactive content instance in accordance with interactive input provided by a user of the player device. During the executing of the interactive content instance, the player device detects a second event marker in the live video stream and subsequently discontinues the executing of the interactive content instance. Corresponding methods and systems are disclosed for both the provider system and the player device of the interactive content delivery system.

Methods and systems for interactive content delivery within a live video stream

An exemplary virtualized projection generation system receives a first frame sequence that includes frames depicting a real-world scene in accordance with a first set of capture parameters associated with a first view of the real-world scene. The virtualized projection generation system identifies a second set of capture parameters distinct from the first set of capture parameters and associated with a second view of the real-world scene distinct from the first view. Based on the first frame sequence, the virtualized projection generation system renders a second frame sequence that includes frames depicting the real-world scene in accordance with the second set of capture parameters associated with the second view of the real-world scene. Corresponding methods and systems are also disclosed.

Methods and systems for generating a customized view of a real-world scene

An exemplary lightmap management system is implemented by a multi-access edge compute ('MEC') server. The system accesses graphics data representative of a 3D model of an object included at a first location within a 3D scene, and identifies a second location from which a light source illuminates the object. The system generates or updates a dynamic lightmap for the object represented by the 3D model based on raytracing of virtual light rays from the second location to the first location. The system provides the dynamic lightmap to a media player device communicatively coupled to the MEC server and configured to apply the dynamic lightmap to the 3D model. For example, the applying of the dynamic lightmap may be performed as part of a rendering of an image that depicts the 3D scene from a viewpoint selected by a user to whom the media player device is presenting the 3D scene.

Methods and devices for bifurcating graphics rendering between a media player device and a multi-access edge compute server

An exemplary image generation system accesses a full atlas frame sequence that incorporates a set of image sequences combined within the full atlas frame sequence as atlas tiles. The system generates a first partial atlas frame sequence that incorporates a first subset of image sequences selected from the set of image sequences incorporated in the full atlas frame sequence, as well as a second partial atlas frame sequence that incorporates a second subset of image sequences selected from the set of image sequences. The second subset includes a different combination of image sequences than the first subset and includes at least one image sequence in common with the first subset. The system provides the first partial atlas frame sequence to a first video encoder and the second partial atlas frame sequence to a second video encoder communicatively coupled with the first video encoder. Corresponding methods and systems are also disclosed.

Methods and systems for using atlas frames to process data representative of a scene

An exemplary data precision preservation system divides a depth representation into a first section and a second section separate from the first section. The system determines data bits representing numbers that correspond to a lowest non-null depth value and a highest non-null depth value represented in the first section, and converts an original set of depth values represented in the first section to a compressed set of depth values normalized based on the lowest and highest non-null depth values represented in the first section. The system then generates a dataset that includes data representative of the compressed set of depth values and an inverse view-projection transform that is based on the lowest and highest non-null depth values represented in the first section and is configured to facilitate conversion of the compressed set of depth values back to the original set of depth values. Corresponding systems and methods are also disclosed.

Methods and systems for preserving precision in compressed depth data

A virtual object and a virtual vantage point are included within a three-dimensional space. An exemplary virtual scene capture system generates a key description frame representative of a state of the virtual object and a state of the virtual vantage point at a first point in a temporal sequence. The virtual scene capture system also generates an update description frame that represents the state of the virtual object and not the state of the virtual vantage point at a second point in the temporal sequence. The virtual scene capture system provides the key description frame and the update description frame to a three-dimensional rendering engine server. The rendering engine server is configured to render, based on the key and update description frames, surface data frames depicting the virtual object from the virtual vantage point. Corresponding methods and systems are also disclosed.

Methods and systems for rendering frames based on virtual entity description frames

An exemplary virtual reality system determines a first confidence metric representing an objective degree to which a pre-modeled object is recognized within a first captured image depicting a scene from a first vantage point. The virtual reality system also determines a second confidence metric representing an objective degree to which the pre-modeled object is recognized within a second captured image depicting the scene from a second vantage point distinct from the first vantage point. The virtual reality system then generates a rendered image that includes a depiction of the pre-modeled object from a third vantage point distinct from the first and second vantage points. The depiction of the pre-modeled object is generated based on data from the first and second captured images, the data prioritized for the depiction of the pre-modeled object according to relative magnitudes of the first and second confidence metrics. Corresponding methods and systems are also disclosed.

Methods and systems for representing a pre-modeled object within virtual reality data

An exemplary volumetric reconstruction system accesses first and second color and depth data captured for a surface point on a surface of an object in a real-world capture space. The first color and depth data is captured by a first capture device positioned to have a first vantage point of the surface of the object, while the second color and depth data is captured for the surface point by a second capture device positioned to have a second vantage point of the surface of the object. Based on the first and second color and depth data, the volumetric reconstruction system determines a confidence field value for a voxel node corresponding to the surface point, and, based on that confidence field value, generates reconstructed color and depth data for a volumetric reconstruction of the surface of the object. Corresponding methods and systems are also disclosed.

An exemplary virtual reality provider system generates a surface data projection based on surface data representative of color characteristics or depth characteristics of surfaces within a three-dimensional ('3D') space. The surface data projection is generated for a portion of the 3D space. The virtual reality provider system applies an image transform operation to the surface data projection to transform the surface data projection. Specifically, the image transform operation transforms the surface data projection to account for a level of detail of the surfaces within the 3D space with respect to a particular vantage point within the 3D space. Corresponding methods and systems are also disclosed.

Methods and systems for generating a surface data projection that accounts for level of detail

An exemplary directional occlusion system includes an object modeling system and a media player device. The object modeling system accesses a model of a virtual object to be integrated into a three-dimensional ('3D') scene, the model including texture data defining respective sets of directional occlusion values for surface points on a surface of the virtual object. The object modeling system further generates a set of directional irradiance maps. The object modeling system provides the directional irradiance maps and the model storing the directional occlusion values to the media player device. The media player device receives the model and the directional irradiance maps and, based on this received data, renders the virtual object so as to appear to a user to be integrated into the 3D scene.

Growing community of inventors

Rochester, NY, United States of America

Oliver S Castaneda