Hypevr

Caoyang Jiang

Jason Juang

Anthony Tran

Jiang Lan

Xiaolin Liu

Qi Yao

A system and method for processing volumetric video is disclosed. The process includes receiving three-dimensional mesh data and texture data defining three-dimensional and textural characteristics of a physical location captured as volumetric video, dividing the three-dimensional mesh data into sub-parts defining a mesh tile, each mesh tile making up only a portion of the three-dimensional mesh data, and identifying a sub-part of the texture data defining a texture tile, the texture tile corresponding to each of the sub-parts of the mesh tiles and including only texture data relevant to an associated mesh tile. The volumetric video may be encoded by encoding each mesh tile independent of the three-dimensional mesh data as a mesh tile video and each texture tile independent of the texture data as a texture tile video.

Optimized volumetric video playback

A method for compressing geometric data and video is disclosed. The method includes receiving video and associated geometric data for a physical location, generating a background video from the video, and generating background geometric data for the geometric data outside of a predetermined distance from a capture point for the video as a skybox sphere at a non-parallax distance. The method further includes generating a geometric shape for a first detected object within the predetermined distance from the capture point from the geometric data, generating shape textures for the geometric shape from the video, and encoding the background video and shape textures as compressed video along with the geometric shape and the background geometric data as encoded volumetric video.

Live action volumetric video compression/decompression and playback

There is disclosed a system and method for encoding and decoding a geometry sequence. The method includes performing intraframe and interframe comparisons of geometry within the geometry sequence, selecting one or more faces as index faces and encoding only the index faces, and the differences relative to those index faces as a bit stream for transmission. The method further includes enabling decoding of the faces based upon the prediction type and encoding method selected during the encoding process.

Geometry sequence encoder and decoder

There is disclosed a system and method for streaming of volumetric three-dimensional video content. The system includes a separate rendering server and display device such that the rendering server receives pose and motion data from the mobile device and generates completed frames of video for the mobile device. The frames of video are transmitted to the mobile device for display. Predictive algorithms enable the rendering server to predict display device pose from frame-to-frame to thereby reduce overall latency in communications between the rendering server and display device.

Growing community of inventors

San Diego, CA, United States of America

Caoyang Jiang