Burst image fusion and denoising using end-to-end deep neural networks

Abstract

Electronic devices, methods, and non-transitory program storage devices for leveraging machine learning to perform improved image fusion and/or noise reduction are disclosed. When a capture request is received, a neural network may be used to perform fusion and denoising operations on a first set of captured input images. According to some embodiments, the neural network's architecture comprises: a first plurality of network layers configured to compute optical flow information between the first set of input images; a second plurality of network layers configured to perform, at least in part, the fusion and denoising operations on the first set of input images; and a third plurality of skip connections between layers of the second plurality of network layers, wherein parameters for each skip connection of the third plurality of skip connections are warped based on at least part of the optical flow information computed by the first plurality of network layers.