Nikon Corporation

Kiyoshige Shibazaki

Muneki Hamashima

Susumu Mori

Kenichi Ishiga

Junya Hagiwara

Yusuke Takanashi

Masahiro Suzuki

Satoshi Suzuki

Kenji Suzuki

Hideo Hoshuyama

Toshihisa Kuroiwa

Keiichi Nitta

Keiji Osawa

Mamoru Iesaka

Junya Yamashita

Takaaki Hashimoto

Hirofumi Hidari

Yasunobu Nakagawa

Fumiki Nakamura

Yumi Suzuki

Hiroshi Sakakibara

Because conversion from an invisible wavelength band to a visible wavelength band has been performed arbitrarily on a device-by-device basis, the color gamut in the visible color space could not be utilized sufficiently. A first aspect of the present invention provides an image-capturing device including: an image-capturing unit that is photosensitive to light in an invisible band; a generating unit that generates invisible wavelength information defined based on a sensitivity characteristic, which is an output characteristic of the image-capturing unit, to an object light flux wavelength for conversion of image-capturing data generated from an output signal of the image-capturing unit into visible color space image data; and a processing unit that relates the invisible wavelength information to the image-capturing data.

Image-capturing device

An image capturing apparatus includes an image capturing device that captures an image of light from a subject, the light passing through each of wavelength band filters having invisible wavelengths as passbands, in which parts of the passbands of the filters whose center wavelengths are adjacent to each other mutually overlap, and a control unit that causes the image capturing device to capture an image of the light from the subject on which a first irradiation light is irradiated, the first irradiation light having a first spectral distribution in which parts of the respective passbands of the filters overlap with one another, and causes the image capturing device to capture an image of the light from the subject on which a second irradiation light is irradiated, the second irradiation light having a second spectral distribution in which parts of the respective passbands of the filters overlap with one another.

Image capturing with filters of overlapping passbands

To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.

Image sensor, image-capturing apparatus and image-capturing system

A technique is disclosed to obtain first image data including a first pixel value of a first pixel having a no-parallax opening corresponding to a reference direction, a second pixel value of a second pixel having a parallax opening that causes parallax in one direction and a third pixel value of a third pixel having a parallax opening that causes parallax in the opposite direction, to calculate, for a pixel position of the second pixel, a fourth pixel value by averaging the second pixel value at the pixel position and a hypothetical third pixel value and to calculate, for a pixel position of the third pixel, a fifth pixel value by averaging the third pixel value at the pixel position and a hypothetical second pixel value, and to use the first pixel value, the fourth pixel value and the fifth pixel value to produce 2D second image data.

Imaging processing apparatus, image-capturing apparatus, and storage medium having image processing program stored thereon

An image capturing apparatus includes: photoelectric converting elements having a light reception sensitivity to light in a wavelength band from 600 to 2500 nm, and receiving an object light flux to output pixel signals; n types of wavelength filters (n&#x3e;4) allowing passage therethrough of light included in the flux and is in wavelength bands being respectively different, each including the wavelength band; and an image data generator generating image data using the output from an element among those having received the flux passed through one of m types of the wavelength filters (3&#x2264;m&#x3c;n) a combination determined based on a predetermined condition being determined such that among the respective wavelength bands of the m types of filters, a shortest-wavelength side wavelength band and a longest-wavelength side wavelength band overlap, and each filter among the m types allowing passage therethrough of light in the wavelength band including a predetermined effective wavelength band.

Image capturing apparatus and method for generating image data

Image sensor, image-capturing apparatus and image capturing system

An image processing apparatus, comprising: a receiving unit receiving a first image and image-capturing information associated with the first image; a determining unit determining, based on the image-capturing information, whether or not the first image is an image of a subject image in a view point direction corresponding to the aperture mask, using an output signal of an image sensor that includes a pixel array including first parallax pixels having the aperture mask with asymmetric directional properties in the long axis and short axis with respect to incident light flux of a single optical system and positioned to permit a portion of the light flux to pass; and an outputting unit outputting a corrected first image by carrying out a correction process having different frequency properties between the long axis direction and the short axis direction on the subject image in an unfocused region of the first image.

Image processing apparatus, image-capturing apparatus and image processing apparatus control program using parallax image data having asymmetric directional properties

With a conventional stereoimage capturing device, it has been difficult to simply determine the present of a depth. An image capturing device includes an image capturing element in which a first parallax pixel group and a second parallax pixel group that output a first parallax image and a second parallax image, respectively, to cause a parallax are arranged at mutually different positions. The image capturing device computes a differential pixel value of each of a plurality of second parallax output pixels in the second parallax image positioned around a target pixel that is a first parallax output pixel of the first parallax image, the differential pixel value being computed with reference to the target pixel, and generates differential data in which a direction of each of the plurality of second parallax output pixels with reference to the target pixel is associated with the corresponding differential pixel value.

Image capturing device and program to control image capturing device

So as to obtain color parallax images, it has been necessary to prepare an image capturing optical system and an image capturing element that are complex, to capture the parallax images. In view of this, provided is an image processing apparatus including: an image obtaining section that obtains original image data including a pixel having a pixel value of any of primary colors constituting colors of a subject image and a pixel having a pixel value showing at least a parallax of the subject image; and an image generating section that generates, from the original image data, primary color image data made up of pixels having the pixel value of the primary color, and parallax image data made up of pixels having the pixel value showing the parallax.

Image processing apparatus, image processing method and recording medium

Images can be processed using an image processing apparatus including: an image data obtaining section that obtains at least two pieces of parallax image data from an image capturing element that includes color filters and opening masks so that one color filter and one opening mask correspond to one of at least a part of photoelectric conversion elements and outputs the at least two pieces of parallax image data; and a correcting section that corrects color imbalance of a corresponding pixel caused between the at least two pieces of parallax image data, based on at least one of a position of the at least a part of photoelectric conversion elements in the image capturing element and an opening displacement of the opening mask.

Image processing apparatus, image capturing apparatus, and image processing program

An image processing apparatus is provided, that is configured to: extract a first pixel value corresponding to a first viewpoint that is one of a plurality of viewpoints to capture a subject image, at a target pixel position from image data having the first pixel value; extract second and third luminance values corresponding to second and third viewpoints that are different from the first viewpoint, at the target pixel position from luminance image data having the second and third luminance values; and calculate at least any of second and third pixel values of the second and third viewpoints such that a relational expression between the second or third pixel value and the first pixel value extracted by the pixel value extracting unit remains correlated with a relational expression defined by the second and third luminance values.

Image processing device, imaging device, and image processing program

A technique is disclosed to calculate a new pixel value of a particular color of second-viewpoint color image data in such a manner that a difference between the new pixel value of the particular color of the second viewpoint and the pixel value of the particular color of the first-viewpoint color image data maintains correlation with a sum of a difference between the pixel value of a first color component of the second-viewpoint color image data and the pixel value of the first color component of third-viewpoint color image data and a difference between the pixel value of a second color component of the second-viewpoint color image data and the pixel value of the second color component of the third-viewpoint color image data.

Image processing apparatus, image-capturing apparatus, and storage medium having image processing program stored thereon

So as to obtain color parallax images, it has been necessary to prepare an image capturing optical system and an image capturing element that are complex, to capture the parallax images. In view of the above, provided is an image processing apparatus including: an image obtaining section; a disparity amount operation section; and an image converting section.

Image processing apparatus and image processing program

An imaging apparatus including an image generating section that generates first parallax image data based on the output of the first pixel and second parallax image data based on the output of the second pixel. When the imaging element captures an image of an object point located in an unfocused region on the optical axis, a pixel value of a center pixel corresponding to the optical axis in the first parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the first parallax image data, and a pixel value of a center pixel corresponding to the optical axis in the second parallax image data is greater than or equal to 50% of a pixel value of a peak pixel in the second parallax image data.

Imaging apparatus for generating parallax image data

Provided is an imaging apparatus including an imaging section that generates, from a single scene, captured image data including reference image data, first parallax image data having a first parallax in one direction relative to a subject of the reference image data, and second parallax image data having a second parallax in another direction that is opposite the one direction; an adjustment condition acquiring section that acquires an adjustment condition relating to parallax amount adjustment; and an image processing device that processes the reference image data, the first parallax image data, and the second parallax image data, based on the adjustment condition, to generate third parallax image data having a third parallax that is in the one direction and different from the first parallax and fourth parallax image data having a fourth parallax that is in the other direction and different from the second parallax.

Imaging apparatus, image processing device, computer-readable medium having stored thereon an imaging apparatus controlling program, and computer-readable medium having stored thereon an image processing program

Growing community of inventors

Higashimurayama, Japan

Kiyoshige Shibazaki