The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 11, 2024

Filed:

Aug. 06, 2021
Applicant:

Niantic, Inc., San Francisco, CA (US);

Inventors:

Carl Sebastian Toft, Gothenburg, SE;

Daniyar Turmukhambetov, London, GB;

Gabriel J. Brostow, London, GB;

Assignee:

NIANTIC, INC., San Francisco, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06T 5/80 (2024.01); G06T 3/00 (2006.01); G06T 7/187 (2017.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); H04N 5/262 (2006.01); A63F 13/216 (2014.01); A63F 13/65 (2014.01);
U.S. Cl.
CPC ...
G06T 5/80 (2024.01); G06T 3/00 (2013.01); G06T 7/187 (2017.01); G06T 7/50 (2017.01); G06T 7/74 (2017.01); H04N 5/2628 (2013.01); A63F 13/216 (2014.09); A63F 13/65 (2014.09); A63F 2300/69 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30244 (2013.01);
Abstract

An image localization system receives an image of a scene and generates a depth map for the image by inputting the image to a model trained for generating depth maps for images. The system determines surface normal vectors for the pixels in the depth map. The system clusters the surface normal vectors to identify regions in the image corresponding to planar surfaces. The system partitions the image into patches, each of which is a region of connected pixels in the image and corresponds to a cluster of surface normal vectors. The system rectifies the perspective distortion of patches and extracts perspective corrected features from the rectified patches. The system matches the perspective corrected features of the image with perspective corrected features of other images for three-dimensional re-localization.


Find Patent Forward Citations

Loading…