Image processing apparatus, image processing method, imaging apparatus, and recording medium

Abstract

An imaging element of an imaging apparatus has a configuration in which a plurality of pixels provided with a plurality of photoelectric conversion units for receiving light fluxes transmitting each of different pupil partial regions of an image forming optical system are arrayed. A CPU performs control to acquire a plurality of viewpoint images corresponding to different pupil partial regions from the imaging element and to generate output images using an image processing unit. The CPU and the image processing unit sets a detection range of an image shift amount using a photographing condition of an input image and a conversion coefficient for a conversion an image shift amount to a defocus amount, generates an image shift amount distribution of the detection range on the basis of a plurality of viewpoint images, and generates an image shift difference amount distribution. Image processing in accordance with the image shift amount distribution is performed to generate refocused images as output images.