The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Dec. 03, 2019

Filed:

Apr. 18, 2017
Applicant:

Facebook, Inc., Menlo Park, CA (US);

Inventors:

Michael John Toksvig, Palo Alto, CA (US);

Forrest Samuel Briggs, Palo Alto, CA (US);

Brian Keith Cabral, San Jose, CA (US);

Assignee:

Facebook, Inc., Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); H04N 17/00 (2006.01); G06K 9/62 (2006.01); G06T 7/55 (2017.01); H04N 5/232 (2006.01); G06T 5/00 (2006.01); H04N 5/222 (2006.01); G06K 9/20 (2006.01); G06K 9/46 (2006.01); G06K 9/52 (2006.01); G06K 9/66 (2006.01); G06T 15/06 (2011.01); G06T 19/20 (2011.01); G06T 7/70 (2017.01); H04N 7/18 (2006.01); G06T 5/20 (2006.01); H04N 5/247 (2006.01); G06T 7/77 (2017.01); G08B 13/196 (2006.01); H04N 5/225 (2006.01);
U.S. Cl.
CPC ...
H04N 17/002 (2013.01); G06K 9/00201 (2013.01); G06K 9/209 (2013.01); G06K 9/4628 (2013.01); G06K 9/527 (2013.01); G06K 9/6201 (2013.01); G06K 9/6202 (2013.01); G06K 9/627 (2013.01); G06K 9/6255 (2013.01); G06K 9/6256 (2013.01); G06K 9/6269 (2013.01); G06K 9/66 (2013.01); G06T 5/002 (2013.01); G06T 5/20 (2013.01); G06T 7/55 (2017.01); G06T 7/70 (2017.01); G06T 15/06 (2013.01); G06T 19/20 (2013.01); H04N 5/2226 (2013.01); H04N 5/23216 (2013.01); H04N 5/23229 (2013.01); H04N 5/23238 (2013.01); H04N 5/247 (2013.01); H04N 7/181 (2013.01); G06T 7/77 (2017.01); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/30244 (2013.01); G08B 13/19619 (2013.01); G08B 13/19641 (2013.01); H04N 5/2252 (2013.01);
Abstract

A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used to generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.


Find Patent Forward Citations

Loading…