Intel Corporation

Blake C Lucas

Jill MacDonald Boyce

Rita Brugarolas Brufau

Fanny Nina Paravecino

Dmitry Lavrov

An example system for lightweight view dependent rendering is described herein. An example mobile device includes a display, instructions, and processor circuitry to execute instructions to extract a moving region within a first set of frames of volumetric video content captured by a plurality of real-world cameras facing a scene at different angles. The processor circuitry to generate a first billboard based on a cropped area of the frames in the first set of frames, the cropped area corresponding to the first moving region. The processor circuitry to, in response to user selection of a first view of the scene, cause presentation of the first billboard on the display. The processor circuitry to, in response to a change from the first view to a second view of the scene, cause a second billboard to replace the first billboard on the display.

Lightweight view dependent rendering system for mobile devices

An example system for lightweight view dependent rendering is described herein. The system includes at least one memory, and at least one processor to execute instructions to track a moving object within a first view of a scene, the first view captured by a first camera of a plurality of cameras. The plurality of cameras to capture video data of the scene from a plurality of angles. The at least one processor to extract a portion of the video data to obtain a cropped video corresponding to the moving object within the first view. The at least one processor to generate a billboard representation based on the cropped video. The at least one processor to cause the billboard representation to be presented on a display in front of a two-dimensional background.

An apparatus to facilitate encoding of point cloud data is disclosed. The apparatus includes one or more processors to receive point cloud data including a plurality of images and camera parameters, generate encoded point cloud data including a color texture image and a depth image having cropped regions for each of the plurality of images, and metadata to describe the camera parameters and a mapping of the cropped regions to a real coordinate space.

View dependent 3D reconstruction mechanism

An apparatus to facilitate encoding visibility data for view-dependent video is disclosed. The apparatus includes one or more processors to receive point cloud data including a plurality of images and camera parameters associated with each of a plurality of cameras, and encode one or more visibility descriptors for each point in the point cloud data to provide visibility information for each point for a plurality of camera views indicated in the camera parameters.

Volumetric video visibility encoding mechanism

A mechanism is described for facilitating smart point cloud reconstruction of objects in visual scenes in computing environments. An apparatus of embodiments, as described herein, includes one or more processors including one or more graphics processors, and photo-consistency logic to perform line searches on cloud points of an object to enhance photo-consistency between multiple camera views associated with a visual hull encompassing the object in a scene captured by multiple cameras coupled to the one or more processors. The apparatus may further include refinement and application logic to perform a final reconstruction of the object based on the enhanced photo-consistency, where the scene having the reconstructed object is displayed at a display device.

Smart point cloud reconstruction of objects in visual scenes in computing environments

An apparatus to facilitate motion tracking is disclosed. The apparatus includes one or more processors to receive video data including a plurality of point clouds in a time series, convert each of the plurality of point clouds into a deformable model representation and generate an inter-frame mapping between the deformable model representations to track motion between the plurality of point clouds.

Dense motion tracking mechanism

A system, article, and method of 3D reconstruction with volume-based filtering for image processing.

Method and system of 3D reconstruction with volume-based filtering for image processing

Techniques related to pose estimation for an articulated body are discussed. Such techniques may include extracting, segmenting, classifying, and labeling blobs, generating initial kinematic parameters that provide spatial relationships of elements of a kinematic model representing an articulated body, and refining the kinematic parameters to provide a pose estimation for the articulated body.

Volumetric video compression with motion history

Systems and techniques for real-time 3D reconstruction with a depth camera are described herein. Depth measurements received from a depth camera of target may be stored in a depth-measurement data structure. A three-dimensional representation of the target may be stored in a model. A current depth image received from the depth camera may be registered to the model. The depth-measurement data structure may be modified with the current depth image based on the registration. The model may be deformed based on space carving and the modified depth measurement data structure.

Growing community of inventors

San Francisco, CA, United States of America

Blake C Lucas