The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 12, 2021

Filed:

Mar. 19, 2019
Applicant:

Mitsubishi Electric Research Laboratories, Inc., Cambridge, MA (US);

Inventors:

Dehong Liu, Lexington, MA (US);

Suhas Lohit, Tempe, AZ (US);

Hassan Mansour, Boston, MA (US);

Petros Boufounos, Winchester, MA (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/36 (2006.01); G06K 9/62 (2006.01); G06N 3/08 (2006.01); G06N 3/04 (2006.01); G06T 7/00 (2017.01);
U.S. Cl.
CPC ...
G06K 9/6289 (2013.01); G06K 9/6256 (2013.01); G06N 3/0454 (2013.01); G06N 3/08 (2013.01); G06T 7/97 (2017.01); G06T 2207/10036 (2013.01);
Abstract

Systems, methods and apparatus for image processing for reconstructing a super resolution (SR) image from multispectral (MS) images. A processor to iteratively, fuse a MS image with an associated PAN image of the scene. Each iteration includes using a gradient descent (GD) approach with a learned forward operator, to generate an intermediate high-resolution multispectral (IHRMS) image with an increased spatial resolution and a smaller error to the DSRMS image compared to the stored MS image. Project the IHRMS image using a trained convolutional neural network (CNN) to obtain an estimated synthesized high-resolution multispectral (ESHRMS) image, for a first iteration. Use the ESHRMS image and the PAN image, as an input to the GD approach for following iterations. The updated IHRMS image is an input to another trained CNN for the following iterations. After predetermined number of iterations, output the fused high-spatial and high-spectral resolution MS image.


Find Patent Forward Citations

Loading…