The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 16, 2018

Filed:

Nov. 24, 2015
Applicant:

Nokia Technologies Oy, Espoo, FI;

Inventors:

Xin Chen, Evanston, IL (US);

Ruigang Yang, Lexington, KY (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04N 13/02 (2006.01); G06T 3/40 (2006.01); G06T 11/60 (2006.01); G06T 7/00 (2017.01);
U.S. Cl.
CPC ...
H04N 13/0242 (2013.01); G06T 3/40 (2013.01); G06T 7/002 (2013.01); G06T 11/60 (2013.01);
Abstract

In a method, a first video stream is received from a video camera, and a second video stream is received from a depth camera. A pixel mapping between the video camera and the depth camera is known. The video camera has an update rate greater than that of the depth camera. Optical flow in successive frames of the first video stream is measured, and a portion of the optical flow attributable to depth change is extracted. A scaling factor is calculated for each pixel in successive frames of the first video stream to determine whether a depth change has occurred. A perspective depth correction is applied to each pixel having a depth change. The perspective depth correction is based upon the depth of the corresponding pixel in the most recent frame from the second video stream. A combined video stream having an update rate of the video camera and depth information from the depth camera is obtained.


Find Patent Forward Citations

Loading…