The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 04, 2022
Filed:
Jun. 28, 2021
Meta Platforms Technologies, Llc, Menlo Park, CA (US);
Albert Parra Pozo, Santa Clara, CA (US);
Joseph Virskus, Snoqualmie, WA (US);
Ganesh Venkatesh, San Jose, CA (US);
Kai Li, Freemont, CA (US);
Shen-Chi Chen, Belmont, CA (US);
Amit Kumar, Mountain View, CA (US);
Rakesh Ranjan, Mountain View, CA (US);
Brian Keith Cabral, San Jose, CA (US);
Samuel Alan Johnson, Redwood City, CA (US);
Wei Ye, Sunnyvale, CA (US);
Michael Alexander Snower, San Francisco, CA (US);
Yash Patel, Mountain View, CA (US);
Meta Platforms Technologies, LLC, Menlo Park, CA (US);
Abstract
A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.