The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 31, 2018

Filed:

Apr. 17, 2017
Applicant:

Facebook, Inc., Menlo Park, CA (US);

Inventors:

Johannes Peter Kopf, Seattle, WA (US);

Lars Peter Johannes Hedman, Seattle, WA (US);

Richard Szeliski, Bellevue, WA (US);

Assignee:

Facebook, Inc., Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); H04N 13/282 (2018.01); H04N 13/02 (2006.01); G06T 3/00 (2006.01); G06T 3/40 (2006.01); H04N 13/00 (2018.01); H04N 13/128 (2018.01); H04N 13/15 (2018.01); H04N 13/221 (2018.01); H04N 13/261 (2018.01); H04N 13/271 (2018.01); G06T 7/579 (2017.01);
U.S. Cl.
CPC ...
H04N 13/282 (2018.05); G06T 3/0093 (2013.01); G06T 3/4038 (2013.01); H04N 13/0022 (2013.01); H04N 13/0037 (2013.01); H04N 13/026 (2013.01); H04N 13/0221 (2013.01); H04N 13/0271 (2013.01); H04N 13/0282 (2013.01); H04N 13/128 (2018.05); H04N 13/15 (2018.05); H04N 13/221 (2018.05); H04N 13/261 (2018.05); H04N 13/271 (2018.05); G06T 7/579 (2017.01); G06T 2207/10012 (2013.01); G06T 2207/10028 (2013.01); H04N 2013/0081 (2013.01);
Abstract

To enable better sharing and preservation of immersive experiences, a graphics system reconstructs a three-dimensional scene from a set of images of the scene taken from different vantage points. The system processes each image to extract depth information therefrom and then stitches the images (both color and depth information) into a multi-layered panorama that includes at least front and back surface layers. The front and back surface layers are then merged to remove redundancies and create connections between neighboring pixels that are likely to represent the same object, while removing connections between neighboring pixels that are not. The resulting layered panorama with depth information can be rendered using a virtual reality (VR) system, a mobile device, or other computing and display platforms using standard rendering techniques, to enable three-dimensional viewing of the scene.


Find Patent Forward Citations

Loading…