Qualcomm Incorporated

Yu-Ren Lai

Wen-Chun Feng

Hsin Yueh Chang

Hsuan-Ming Liu

The present disclosure provides systems, apparatus, methods, and computer-readable media that support multi-frame depth-of-field (MF-DOF) for deblurring background regions of interest (ROIs), such as background faces, that may be blurred due to a large aperture size or other characteristics of the camera used to capture the image frame. The processing may include the use of two image frames obtained at two different focus points corresponding to the multiple ROIs in the image frame. The corrected image frame may be determined by deblurring one or more ROIs of the first image frame using an AI-based model and/or local gradient information. The MF-DOF may allow selectively increasing a depth-of-field (DOF) of an image to provide focused capture of multiple regions of interest, without causing a reduction in aperture (and subsequently an amount of light available for photography) or background blur that may be desired for photography.

Selectively increasing depth-of-field in scenes with multiple regions of interest

Systems and techniques are provided for processing image data. According to some aspects, a process can include obtaining a frame captured using an image sensor of a device. The process can include detecting an orientation of the device using a position sensor. The process can further include determining, based on the orientation, a transform to be applied to a region of interest in the frame. The process can include applying the transform to the region of interest. The process can further include providing the transformed region of interest to the object detection algorithm.

Enhanced object detection

Image processing performed on images captured with image capture devices may be used to improve upon some of the problems with images captured from devices, including images captured from devices with larger aperture lenses, and, in some particular examples, mobile devices with larger aperture lenses. Multiple images may be captured by the capture device and processing applied to generate a single image through fusing of the multiple images. One potential benefit obtained with fusion of multiple images is a single image with an effective depth of focus (DOF) larger than that available in a single image obtained from the capture device. The DOF of the fused image may be larger than a single image and/or may include multiple distinct in-focus focal distances, whereas a single image from a single capture device has only a single in-focus focal distance.

Growing community of inventors

Nantou County, Taiwan

Yu-Ren Lai