Meta Platforms Technologies, LLC

Joseph Virskus

Brian Keith Cabral

Ganesh Venkatesh

Samuel Alan Johnson

Albert Parra Pozo

Amit Kumar

Michael Alexander Snower

Rakesh Ranjan

Wei Ye

Yash Patel

Kai Li

Shen-Chi Chen

A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

Holographic calling for artificial reality

Growing community of inventors

Snoqualmie, WA, United States of America

Joseph Virskus