Verizon Patent and Licensing Inc.

Denny Breitenfeld

Mohammad Raheel Khalid

Oliver S Castaneda

Syed Meeran Kamal

Michael Lodato

Pai Moodlagiri

Rene Sepulveda

Xavier Hansen

Vidhya Seran

Lama Hewage Ravi Prathapa Chandrasiri

Ali Jaafar

Christian Egeler

Steven L Smith

Nazneen Khan

William Patrick Gervasio

Solmaz Hajmohammadi

Dan Sun

Richard John Kern, Ii

Garry Guan

Qian Su

Samuel Charles Mindlin

Liang Luo

Elena Dotsenko

Zhiguang Eric Zhang

Eric Norman Azares

Ching-Kit Chan

Timothy Atchley

Robert Strelec

Jeremy E Hampsten

Kevin M Byrd

Duane Burton Molitor

An illustrative 3D modeling system generates a hair orientation image based on a 2D image depicting a human subject having hair. The hair orientation image includes semantic segmentation data indicating whether image elements of the hair orientation image depict the hair of the human subject or content other than the hair. The hair orientation image further includes hair flow data indicating a flow direction of the hair depicted by various image elements. Based on the hair orientation image, the 3D modeling system generates a 3D model of the hair of the human subject. The 3D modeling system then integrates the 3D model of the hair of the human subject with a 3D model of a body of the human subject. Corresponding methods and systems are also disclosed.

Methods and systems for 3D modeling of a human subject having hair based on 2D imagery

An illustrative content augmentation system identifies a presentation context dataset indicating how an extended reality (XR) presentation device is to present XR content in connection with a presentation of primary content. Based on the presentation context dataset, the content augmentation system selects a subset of secondary content items from a set of secondary content items each configured for presentation as XR content that augments the presentation of the primary content. The content augmentation system also provides the selected subset of secondary content items for presentation by the XR presentation device in connection with the presentation of the primary content. Corresponding methods and systems are also disclosed.

Methods and systems for customizing augmentation of a presentation of primary content

An exemplary virtual reality media provider system ('system') receives, from a media player device ('device') by way of a network, a request for the device to provide a user with an immersive virtual reality experience. The system transmits, to the device by way of the network and in response to the request, a specification file corresponding to the immersive virtual reality experience. The specification file comprises data that defines a plurality of elements included in the immersive virtual reality experience, associates an event with a particular element included in the plurality of elements, and associates a behavior with the event that is associated with the particular element, the behavior configured to be performed with respect to the particular element in response to an occurrence of the event within the immersive virtual reality experience. The device uses the specification file to provide the user with the immersive virtual reality experience.

Methods and systems for specification file based delivery of an immersive virtual reality experience

An illustrative multiscale data system determines a first distance between a first object in a scene and a virtual vantage point at the scene. The multiscale data system also determines a second distance between a second object in the scene and the virtual vantage point. In an example in which the second distance is greater than the first distance, the multiscale data system generates, based on the first and second distances, a tiled representation associated with the virtual vantage point. The tiled representation in this example includes a first representation of the first object rendered at a first quality level and a second representation of the second object rendered at a second quality level lower than the first quality level. Corresponding methods and systems are also disclosed.

Methods and systems for data representing objects at different distances from a virtual vantage point

An illustrative volumetric processing system generates a plurality of point clouds each representing an object from a different vantage point. Based on the plurality of point clouds, the volumetric processing system consolidates point cloud data corresponding to a surface of the object. Based on the consolidated point cloud data for the object, the volumetric processing system generates a voxel grid representative of the object. Based on the voxel grid, the volumetric processing system generates a set of rendered patches each depicting at least a part of the surface of the object. Corresponding methods and systems are also disclosed.

Systems and methods for processing volumetric data

An exemplary plurality of system nodes is arranged in a multi-stage modular architecture. A first system node performs a first frame processing task on a first frame of a frame sequence, and a second system node performs a second frame processing task on a second frame of the frame sequence. The first and second system nodes are included respectively, within first and second pipeline stages of the multi-stage modular architecture, and the first and second frame processing tasks are associated with the respective first and second pipeline stages. Subsequent to performing the first and second frame processing tasks, the first and second system nodes transmit the first and second frames to additional system nodes included within subsequent pipeline stages of the multi-stage modular architecture. These transmissions are synchronized so as to be performed within a predetermined threshold time of one another. Corresponding systems and methods are also disclosed.

Systems and methods for synchronizing frame processing within a multi-stage modular architecture

An exemplary virtual reality system includes a management device, a synchronization device, and a gatekeeper device communicatively coupled to the management device and the synchronization device by way of a network. The gatekeeper device is configured to receive, at a particular time, a frame of a surface data frame sequence that the gatekeeper device is responsible for processing. The gatekeeper device is also configured to transmit, to the synchronization device, the particular time at which the gatekeeper device received the frame, and to receive, from the synchronization device, a timeframe during which the gatekeeper device is to transmit the frame. The gatekeeper device is further configured to transmit, to the management device during the timeframe received from the synchronization device, the frame of the surface data frame sequence. Corresponding systems and methods are also disclosed.

Systems and methods for synchronizing surface data management operations for virtual reality

An illustrative multiscale data system obtains first and second datasets representative of respective first and second objects in a scene as viewed from a virtual vantage point at the scene. The system determines respective distances between the respective first and second objects and the virtual vantage point. Based on these distances, the system scales one or more respective representations of the objects rendered from the datasets to cause a first representation of the first object to be of a first quality level higher than a second quality level of a second representation of the second object. The system also generates a tiled representation that is associated with the virtual vantage point and includes the first representation of the first object at the first quality level and the second representation of the second object at the second quality level. Corresponding methods and systems are also disclosed.

Methods and systems for generating multiscale data representing objects at different distances from a virtual vantage point

An exemplary image simulation system accesses an image depicting imagery captured at a capture resolution from a capture vantage point. The image simulation system partitions the image into a plurality of simulated images, and determines a respective virtual resolution and a respective virtual vantage point for each of the simulated images in the plurality of simulated images. Each virtual resolution determined by the image simulation system is different from the capture resolution and each virtual vantage point determined by the image simulation system is different from the capture vantage point. The image simulation system represents each simulated image of the plurality of simulated images as a distinct image captured at the respective virtual resolution and from the respective virtual vantage point that have been determined for the simulated image. Corresponding methods and systems are also disclosed, including methods and systems for combining captured images to form a single simulated image.

Methods and systems for simulating image capture in an extended reality system

An exemplary image generation system accesses a full atlas frame sequence that incorporates a set of image sequences combined within the full atlas frame sequence as atlas tiles. The system generates a first partial atlas frame sequence that incorporates a first subset of image sequences selected from the set of image sequences incorporated in the full atlas frame sequence, as well as a second partial atlas frame sequence that incorporates a second subset of image sequences selected from the set of image sequences. The second subset includes a different combination of image sequences than the first subset and includes at least one image sequence in common with the first subset. The system provides the first partial atlas frame sequence to a first video encoder and the second partial atlas frame sequence to a second video encoder communicatively coupled with the first video encoder. Corresponding methods and systems are also disclosed.

Methods and systems for using atlas frames to process data representative of a scene

An exemplary volumetric processing system includes a set of point cloud generators, a point cloud organizer, a voxelizer, and a set of patch renderers. The point cloud generators correspond to image capture systems disposed at different vantage points to capture color and depth data for an object located within a capture area. The point cloud generators generate respective point clouds for the different vantage points based on the captured surface data. The point cloud organizer consolidates point cloud data that corresponds to a surface of the object. The voxelizer generates a voxel grid representative of the object based on the consolidated point cloud data. The set of patch renderers generates, based on the voxel grid, a set of rendered patches each depicting at least a part of the surface of the object. Corresponding systems and methods are also disclosed.

Systems and methods for processing volumetric data using a modular network architecture

A virtual object and a virtual vantage point are included within a three-dimensional space. An exemplary virtual scene capture system generates a key description frame representative of a state of the virtual object and a state of the virtual vantage point at a first point in a temporal sequence. The virtual scene capture system also generates an update description frame that represents the state of the virtual object and not the state of the virtual vantage point at a second point in the temporal sequence. The virtual scene capture system provides the key description frame and the update description frame to a three-dimensional rendering engine server. The rendering engine server is configured to render, based on the key and update description frames, surface data frames depicting the virtual object from the virtual vantage point. Corresponding methods and systems are also disclosed.

Methods and systems for rendering frames based on virtual entity description frames

An exemplary method includes a virtual reality content rendering system receiving two-dimensional ('2D') color data and depth data captured by a plurality of capture devices disposed at different vantage points in relation to a three-dimensional ('3D') scene, receiving metadata, generating, for each vantage point associated with each respective capture device included in the plurality of capture devices, and based on the metadata and the depth data, a partial 3D mesh projected into a virtual 3D space to produce a partial representation of the 3D scene in the virtual 3D space, and generating, based on the partial 3D meshes projected into the virtual 3D space, and from an arbitrary viewpoint within the virtual 3D space, an image view of the virtual 3D space. The generating of the image view may include blending color samples of overlapping sections off the partial 3D meshes projected into the virtual 3D space.

Methods and systems for rendering virtual reality content based on two-dimensional (2D) captured imagery of a three-dimensional (3D) scene

An exemplary virtual reality media provider system differentiates static objects depicted in two-dimensional video data from dynamic objects depicted in the two-dimensional video data. Based on the differentiating of the static objects from the dynamic objects, the virtual reality media provider system generates dynamic volumetric models of the surfaces of the static objects and the dynamic objects. The virtual reality media provider system updates the dynamic volumetric models of the surfaces of the static objects with a lower regularity or on an as-needed basis, and the virtual reality media provider system separately updates the dynamic volumetric models of the surfaces of the dynamic objects with a higher regularity. The higher regularity is higher than the lower regularity and keeps the dynamic volumetric models of the surfaces of the dynamic objects up-to-date with what is occurring in the two-dimensional video data. Corresponding methods and systems are also disclosed.

Methods and systems for creating a volumetric representation of a real-world event

An exemplary virtual reality media provider system receives two-dimensional ('2D') video data for surfaces of first and second objects located in a natural setting. The 2D video data is captured by first and second capture devices disposed at different positions with respect to the objects. The system distinguishes the first object from the second object by performing a plurality of techniques in combination with one another. The plurality of techniques include determining that the first object is moving in relation to the second object; and determining that, from a vantage point of at least one of the different positions, a representation of the first object captured within the 2D video data does not overlap with a representation of the second object. Based on the received 2D video data and the distinguishing of the first and second objects, the system generates an individually-manipulable volumetric model of the first object.

Growing community of inventors

Florham Park, NJ, United States of America

Denny Breitenfeld