The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 29, 2023

Filed:

Mar. 05, 2021
Applicant:

Niantic, Inc., San Francisco, CA (US);

Inventors:

James Watson, London, GB;

Michael David Firman, London, GB;

Aron Monszpart, London, GB;

Gabriel J. Brostow, London, GB;

Assignee:

Niantic, Inc., San Francisco, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 19/00 (2011.01); G06N 20/00 (2019.01); G06T 7/10 (2017.01); G06T 7/50 (2017.01); G06T 19/20 (2011.01); G06T 17/00 (2006.01); G06V 10/26 (2022.01); G06V 10/774 (2022.01); G06V 20/10 (2022.01);
U.S. Cl.
CPC ...
G06T 19/006 (2013.01); G06N 20/00 (2019.01); G06T 7/10 (2017.01); G06T 7/50 (2017.01); G06T 19/20 (2013.01); G06V 10/26 (2022.01); G06V 10/774 (2022.01); G06V 20/10 (2022.01); G06T 2207/20081 (2013.01); G06T 2219/2004 (2013.01);
Abstract

A model predicts the geometry of both visible and occluded traversable surfaces from input images. The model may be trained from stereo video sequences, using camera poses, per-frame depth, and semantic segmentation to form training data, which is used to supervise an image to image network. In various embodiments, the model is applied to a single RGB image depicting a scene to produce information describing traversable space of the scene that includes occluded traversable. The information describing traversable space can include a segmentation mask of traversable space (both visible and occluded) and non-traversable space and a depth map indicating an estimated depth to traversable surfaces corresponding to each pixel determined to correspond to traversable space.


Find Patent Forward Citations

Loading…