The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 12, 2018

Filed:

May. 04, 2015
Applicant:

Avigilon Fortress Corporation, Vancouver, British Columbia, CA;

Inventors:

Shirley Zhou, Herndon, VA (US);

Don Madden, State College, PA (US);

Tae Eun Choe, Reston, VA (US);

Andrew W. Scanlon, Falls Church, VA (US);

Assignee:
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06T 19/00 (2011.01); G06T 17/05 (2011.01); G06T 7/00 (2017.01);
U.S. Cl.
CPC ...
G06T 19/006 (2013.01); G06T 7/0038 (2013.01); G06T 7/0046 (2013.01); G06T 7/0057 (2013.01); G06T 17/05 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/10032 (2013.01); G06T 2207/30212 (2013.01); G06T 2207/30241 (2013.01);
Abstract

A method is provided for augmenting video feed obtained by a camera of a aerial vehicle to a user interface. The method can include obtaining a sequence of video images with or without corresponding sensor metadata from the aerial vehicle; obtaining supplemental data based on the sequence of video images and the sensor metadata; correcting an error in the sensor metadata using a reconstruction error minimization technique; creating a geographically-referenced scene model based on a virtual sensor coordinate system that is registered to the sequence of video images; overlaying the supplemental information onto the geographically-referenced scene model by rendering geo-registered data from a 3D perspective that matches a corrected camera model; creating a video stream of a virtual representation from the scene from the perspective of the camera based on the overlaying; and providing the video stream to a UI to be render onto a display.


Find Patent Forward Citations

Loading…