Meta Platforms Technologies, LLC

Wei Ye

Brian Keith Cabral

Ganesh Venkatesh

Samuel Alan Johnson

Albert Parra Pozo

Amit Kumar

Michael Alexander Snower

Rakesh Ranjan

Shen-Chi Chen

Yash Patel

Joseph Virskus

Kai Li

A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

Holographic calling for artificial reality

Growing community of inventors

Sunnyvale, CA, United States of America

Wei Ye