Canon Kabushiki Kaisha

Norihito Hiasa

Koshi Hatakeyama

Kaoru Eguchi

Koichi Fukuda

Masafumi Kimura

Tomohiro Nishiyama

Kazuhiro Yahata

Shohei Tsutsumi

Masakazu Kobayashi

Yoshihisa Tashiro

Yuichi Kusumi

Hironobu Koga

An image processing method includes a first step of acquiring input data including a captured image and optical system information relating to a state of an optical system used for capturing the captured image and a second step of inputting the input data to a machine learning model and of generating an estimated image acquired by sharpening the captured image or by reshaping blurs included in the captured image.

Image processing method, image processing apparatus, image processing system, and manufacturing method of learnt weight

An image processing method includes acquiring a captured image obtained by imaging, generating a first image by correcting a blur component of the captured image, and generating a second image based on the captured image, the first image, and weight information. The weight information is generated based on (i) information on brightness of the captured image or information on a scene of the captured image and (ii) information on a saturated area in the captured image.

Image processing method, image processing apparatus, image processing system, and memory medium

An image processing method includes generating a first image by inputting a captured image, which has been acquired by imaging using an optical system, into a machine learning model, acquiring information on optical performance of the optical system, and generating a second image based on the captured image, the first image, and first weight information. The first weight information is generated based on the information on the optical performance and information on a saturated area in the captured image.

An image processing method includes steps of acquiring first model output generated based on a captured image by a first machine learning model, acquiring second model output generated based on the captured image by a second machine learning model which is different from the first machine learning model, and generating an estimated image by using the first model output and the second model output, based on a comparison based on the second model output and one of the captured image and first model output.

Image processing method, image processing apparatus and image processing system that suppresses a side effect that occurs when an image is estimated based on a captured image by using a machine learning model

An image processing method includes a first step of acquiring a captured image, and a second step of generating a first map based on the captured image using a machine learning model. The first map is a map indicating a magnitude and range of a signal value in an area where an object in a luminance saturation area in the captured image is spread by a blur generated in an imaging step of the captured image.

Image processing method and apparatus, training method and apparatus of machine learning model, and storage medium

A method for processing an image uses a generator which is a machine learning model. The generator converts an input low resolution image into a first feature map. From the first feature map, a first intermediate image and a second intermediate image each having resolution higher than resolution of the low resolution image are generated. Based on the first intermediate image and the second intermediate image, an estimated image having higher resolution than the resolution of the low resolution image is generated.

Image processing method, image processing apparatus, learning method, learning apparatus, and storage medium

An image processing method comprising steps of obtaining a first map representing a region outside a dynamic range of an input image based on a signal value in the input image and a threshold of the signal value, and inputting input data including the input image and the first map and executing a recognition task or a regression task.

Image processing method, image processing apparatus, image processing system, and learnt model manufacturing method

An image processing method configured to correct a captured image using a neural network includes a first step of determining an inversion axis for a partial image or a filter of the neural network according to a position in the captured image of the partial image that is part of the captured image, a second step of determining a positional relationship among pixels of color components in an image input to the neural network corresponding to the inversion axis, and a third step of generating a corrected image obtained by correcting an input image by processing, using the neural network, the input image generated from the captured image based on the positional relationship.

Image processing method, image processing apparatus, imaging apparatus, and storage medium, that correct a captured image using a neutral network

An image processing method includes the steps of acquiring a first image obtained by imaging an object space through a first pupil in an optical system, and a second image obtained by imaging the object space through a second pupil different from the first pupil in the optical system, and generating a blur reshaped image in which a blur caused by a defocus is reshaped based on the first image and the second image using a neural network.

Image processing method, image processing apparatus, imaging apparatus, lens apparatus, storage medium, and image processing system

An image processing method includes acquiring input data including an input image and a noise map representing a noise amount in the input image based on an optical black area corresponding to the input image, and inputting the inputdata into a neural network to execute a task of a recognition or regression.

Image processing method, image processing apparatus, storage medium, image processing system, and manufacturing method of learnt model

An image processing method includes a first step configured to obtain a first ground truth image and a first training image, a second step configured to generate a second around truth image and a second training image by applying mutually correlated noises to the first ground truth image and the first training image, and a third step configured to make a neural network learn based on the second ground truth image and the second training image.

Image processing method, image processing apparatus, learnt model manufacturing method, and image processing system

An image processing method includes the steps of acquiring a training image and a correct image, inputting the training image into a multilayer neural network to generate an output image, performing a gamma correction for each of the correct image and the output image and calculating an error between the correct image after the gamma correction and the output image after the gamma correction, and updating a network parameter of the neural network using the error.

Image processing method that performs gamma correction to update neural network parameter, image processing apparatus, and storage medium

An image processing apparatus includes an image acquirer configured to acquire a first image that is generated by image capturing and includes information of light intensity distributions obtained with a plurality of different exposures provided with transmittance distributions that are different from one another, an information acquirer configured to acquire information on the transmittance distributions, and an image estimator configured to separate image signals corresponding to two or more exposures among the plurality of exposures from the first image in the same pixel based on an estimation using the information on the transmittance distributions, and to generate two or more second images using the separated image signals.

Image processing apparatus, image capturing apparatus, and non-transitory computer-readable storage medium

An image processing method of highly accurately correcting an optical degradation of an image pickup apparatus while also suppressing adverse effects is provided. The image processing method includes a step of obtaining a partial area of an input image shot by using an image pickup apparatus, a step of obtaining previously learnt correction information varying in accordance with a position of the partial area, and a correction step of generating a corrected partial area in which an optical degradation of the partial area caused by the image pickup apparatus is corrected by using the partial area and the correction information.

Growing community of inventors

Utsunomiya, Japan

Norihito Hiasa