Reference-based super-resolution for image and video enhancement

Abstract

Devices, methods, and computer readable media to provide enhanced images in multi-camera systems, e.g., by using images captured by cameras with different optical properties and/or sensors. In one embodiment, the techniques comprise reference-based image super-resolution techniques for producing, with a first neural network employing robust feature aggregation techniques (e.g., techniques able to blend between single-image enhancement and feature aggregation, when appropriate), an enhanced output image that attempts to match the quality characteristics of each of region in a lower quality (e.g., shorter focal length, larger field of view (FOV)) input image with the quality characteristics of the region's determined guidance region from at least a second, i.e., higher quality (e.g., longer focal length, smaller FOV image) input image. The guidance regions from the higher quality image that are determined for each region from the lower quality input image may be determined by performing homographic mapping and/or semantic feature matching techniques.