Canon Kabushiki Kaisha

Kiyokatsu Ikemoto

Akinari Takagi

Hikaru Hoshi

Kazuya Nobayashi

Aihiko Numata

Chiaki Inoue

Takuya Ishibashi

Yosuke Eguchi

Yuichi Kusumi

Yoshiaki Ida

Masahiro Tsujibayashi

Taisei Mori

Shingo Mori

Kanji Suzuki

An image processing apparatus generates an image pertaining to a subject. The apparatus obtains a captured image and asperity information of the subject; generates 3D data of the subject based on the captured image and the asperity information obtained; makes a change instruction to change a form of the 3D data generated; and generates, as the image pertaining to the subject, an image corresponding to the 3D data changed based on the change instruction.

Image processing apparatus, image processing method, recording medium, and image processing system, with change instruction to change form of 3D data

A shape information acquisition apparatus, comprises a memory and at least one processor and/or at least one circuit to perform operations of the following units. The acquiring unit is configured to acquire photometric images for which a subject is illuminated from different directions by an illuminance portion and a pattern projection image for which a predetermined light pattern is projected onto the subject by a projection portion. The detection unit configured to detect a position of the illuminance portion based on the pattern projection image. The shape calculation unit configured to calculate shape information for the subject based on the photometric images and the position of the illuminance portion.

Shape information acquisition apparatus and shape information acquisition method

An apparatus includes an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels, and a processor for performing image processing on an image that is obtained by using the imaging element. The processor includes a first obtaining unit that obtains first shape information based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information by using the plurality of parallax images, and a third obtaining unit that obtains third shape information by using the first shape information and the second shape information.

Imaging apparatus, method of processing image, and storage medium

An image shift amount calculation apparatus comprises: an obtaining unit that obtains a pair of images having parallax; a generation unit that generates, from the pair of images, an image pair for each of a plurality of hierarchal levels having different resolutions; and a calculation unit calculates an image shift amount for an image pair in a predetermined first hierarchal level among the plurality of hierarchal levels, determines, on the basis of the image shift amount in the first hierarchal level, a second hierarchal level, among the plurality of hierarchal levels, where the calculation of the image shift amount is to end, and calculates an image shift amount of the image pair in the second hierarchal level using the image shift amount in the first hierarchal level.

Image shift amount calculation apparatus and method, image capturing apparatus, defocus amount calculation apparatus, and distance calculation apparatus

Provided is a depth detection apparatus for detecting depth information from a first and a second image based on a light flux passing through different pupil regions, the apparatus including an image generator that generates a third and a fourth image by subjecting the first and the second image to a filter, a depth detector that detects depth information from a relative positional shift amount between the third and the fourth image, a representative value acquirer that acquires a representative value of spatial frequencies of the third or the fourth image from a frequency characteristic of the filter, and a confidence determiner that determines confidence for the depth information from the representative value. The confidence is determined as a value representing higher confidence as the representative value is greater.

Depth detection apparatus and depth detection method

A distance detecting apparatus includes an imaging unit that generates a first image signal and a second image signal and an arithmetic processing unit. The distance detecting apparatus detects the distance to a subject on the basis of an amount of defocus indicating the distance between an imaging plane of the imaging unit and an image forming plane of light fluxes. The arithmetic processing unit executes a first step of calculating an amount of temporary defocus on the basis of the first image signal and the second image signal, a second step of calculating a conversion factor used to convert an amount of image displacement between a first image and a second image into the amount of defocus on the basis of the amount of temporary defocus, and a third step of calculating the amount of defocus by using the conversion factor.

Distance detecting apparatus

A depth detection apparatus that detects depth information on a depth to an object on the basis of first and second signals corresponding to first and second pupil regions of an exit pupil, including: a first calculation unit that calculates a first shift amount between the first and second signals; a signal processing unit that generates a corrected signal by performing filter processing on at least one of the first and second signals, the filter processing being performed to relatively displace the first and second signals by a displacement amount corresponding to the first shift amount; and a second calculation unit that calculates a second shift amount between the filtered first and second signals or between signals, one of which is filtered in the filter processing and the other one of which is unfiltered.

Depth detection apparatus, imaging apparatus and depth detection method

The present invention relates to a distance measuring apparatus including an imaging device and a calculation unit calculating a distance to a subject on the basis of an electrical signal. The imaging device includes a signal acquisition unit that acquires a first electrical signal based on a beam that has passed through a first region off the center of the exit pupil in a predetermined direction; a second electrical signal based on a beam that has passed through a second region off the center of the exit pupil in a direction opposite to the predetermined direction; and a third electrical signal based on a beam that has passed through a region eccentric from the first region in the direction opposite to the predetermined direction. The calculation unit performs a signal correction process for generating a first corrected signal and a distance calculation process for calculating the distance.

Distance measuring apparatus

Provided is a depth detection apparatus having: a shift amount acquisition unit to acquire a provisional image shift amount; a filter processing unit to perform filter processing on one or both of the first and second signal; and a depth deriving unit to derive the depth information on an object, based on a positional shift amount between the filtered first signal and the filtered second signal. A phase term of the filter is a function generated by a second function by a coefficient, wherein the second function is generated based on a phase transfer function corresponding to the first or second pupil region and on the provisional image shift amount, and the coefficient is a real number greater than 0 and smaller than 1.

A distance detecting device includes a distance calculation unit configured to calculate a distance to a target of imaging based on a first signal corresponding to a luminous flux having passed through a first pupil region of an exit pupil in an imaging optical system, and a second signal corresponding to a luminous flux having passed through a second pupil region different from the first pupil region, and a signal processing unit configured to perform a filtering process on at least one of the first signal and the second signal by using a band pass filter having a lower number of cells in a first direction than a number of cells in a second direction perpendicular to the first direction, and a filter for phase correction having a higher number of cells in the first direction than the number of cells in the second direction.

Distance detecting device, imaging apparatus, distance detecting method and parallax-amount detecting device

An imaging apparatus includes an imaging optical system having an exit pupil and an image sensor having pixels including first and second pixels. Each pixel has high and low sensitivity light receiving sections and a pupil divider. Each of the first pixels is arranged near one of the second pixels. The pupil divider guides light from a part of the exit pupil of the imaging optical system to the high or low sensitivity light receiving section in a first pixel and guides light from another part of the exit pupil to the high or low sensitivity light receiving section in the neighboring second pixel. The positional relation between the high and low sensitivity light receiving sections relative to the center in a pixel is mutually inverted in the pupil dividing direction between a first pixel and the neighboring second pixel.

Imaging apparatus for distance detection using high and low sensitivity sensors with inverted positional relations

An imaging device for photoelectric conversion includes a plurality of pixels receiving light fluxes from an exit pupil of an optical system. At least part of the pixels are ranging pixels, each including a plurality of photoelectric conversion sections configured to receive light fluxes from a plurality of pupil areas in the exit pupil and a waveguide formed by a core and a clad that guides the light fluxes to the photoelectric conversion section. At least some of the ranging pixels include respective attenuating members arranged in the clad at a position opposite to the photoelectric conversion sections corresponding to pupil areas containing a large number of light fluxes representing a large angle relative to the normal at the pixel center of the ranging pixel having the attenuating member with regard to the pupil division direction on the ranging pixel corresponding to the displacement direction of the pupil areas.

Imaging device and imaging apparatus

Provided is a ranging apparatus or the like capable of high-accuracy ranging. The image sensor, comprising multiple pixels, wherein the pixels comprises a ranging pixel including a light collecting member, a waveguide, and first and second photoelectric conversion units, wherein: the first and second units are arranged along a first direction; when a region decentered from a center of pupil in a second direction opposite to the first direction is a first pupil region, a region decentered in the first direction is a second pupil region, a region located in the second direction is a first region, and a region located in the first direction is a second region, the collecting member collects lights passed through the first and second pupil regions to the second and first regions; and the waveguide guides lights collected in the second and first regions toward the first and second units.

Image sensor, ranging apparatus, and imaging apparatus

Provided is a solid-state imaging device capable of ranging with high precision even when the pixel size is small. The solid-state imaging device includes: an optical waveguide having multiple regions with different refractive indices; and a photoelectric conversion unit for converting light guided through the optical waveguide into an electrical signal. The optical waveguide includes a main waveguide located on a light incident side, and a first sub waveguide and a second sub waveguide connected to the main waveguide and located on the photoelectric conversion unit side. The main waveguide guides light which enters from a first direction and light which enters from a second direction. The first sub waveguide and the second sub waveguide guide light which has entered from the first direction and has passed through the main waveguide and light which has entered from the second direction and has passed through the main waveguide, respectively.

Solid-state imaging device having main waveguide with first and second sub waveguides

A ranging apparatus has an imaging unit including a pixel group for acquiring first and second images formed by luminous fluxes having passed through first and second pupil areas of an imaging optical system, and a calculation unit configured to create third and fourth images by performing convolution integrals on the first and second images with corrected first and second image modification functions, and to calculate a distance up to the subject by comparison of the third and fourth images, wherein the corrected first and second image modification functions are formed by causing centroid positions calculated based on data of sampling points of the first and second image modification functions corresponding to pixel arrangement of the pixel group to each coincide with a sampling point closest to the centroid position; and the convolution integral is performed by taking the sampling point closest to the centroid position as a reference point.

Growing community of inventors

Yokohama, Japan

Kiyokatsu Ikemoto