Olympus Corporation

Tokyo Institute of Technology

Sunao Kikuchi

Yasuhiro Komiya

Masayuki Tanaka

Masatoshi Okutomi

Yusuke Monno

Ken Ioka

Yasuhiro Fukunaga

Kazunori Yoshizaki

Daisuke Kiku

An information processing system includes a processor. The trained model is trained to resolution recover a low resolution training image generated by low resolution processing performed on a high resolution training image to a high resolution training image that represents a high resolution image captured with a predetermined object through the first imaging system. The low resolution processing represents processing that generates a low resolution image as if captured with the predetermined object through the second imaging system and processing that simulates the second imaging method, and includes processing that simulates a resolution characteristic of an optical system of the second imaging system. The processor uses the trained model to resolution recover the processing target image captured through a second imaging system to an image having a resolution at which the first imaging system performs imaging.

Information processing system, endoscope system, and information storage medium

An endoscope scope includes: an imaging device that acquires image information; a color filter disposed on pixels of the imaging device and in which primary-color pixels and complementary-color pixels coexist; a detector that detects whether or not an image processor that generates an observation image based on the acquired image information via the color filter is compatible with the image information consisting of an array in which the primary-color pixels and the complementary-color pixels coexist; and a converter that performs Bayer-conversion processing for converting the image information to a Bayer array in a case in which the detector detects that the image processor is not compatible with the image information consisting of the array, and that does not perform the Bayer-conversion processing on the image information in a case in which the detector detects that the image processor is compatible with the image information consisting of the array.

Endoscope scope, endoscope processor, and endoscope adaptor

An endoscope device is disclosed which includes an image processing unit that generates a first image corresponding to light in a green wavelength band on the basis of an imaging signal generated by an imaging device when a light source unit emits first illumination light or second illumination light, and generates a second image corresponding to light in other one of wavelength bands. Resolution of the first image obtained when the light source unit emits the first illumination light is equal to or higher than resolution of the first image obtained when the light source unit emits the second illumination light, and resolution of the second image obtained when the light source unit emits the second illumination light is higher than resolution of the second image obtained when the light source unit emits the first illumination light.

Endoscope device, image processing apparatus, image processing method, and program

An endoscope device includes: a light source configured to perform any one of simultaneous lighting and sequential lighting; an image sensor including a plurality of pixels; a plurality of filters including at least one type of primary filter and a complementary filter; and a processor including hardware, the processor being configured to cause the light source to switch between the simultaneous lighting and the sequential lighting, when the simultaneous lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter, and when the sequential lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter as an imaging signal generated from a pixel corresponding to the at least one type of primary filter.

Endoscope device, image processing method, and computer readable recording medium

An image processing device includes: a separation unit configured to separate a plurality of wide-band image signals corresponding to wide-band light passing through each of a plurality of wide-band filters and a narrow-band image signal corresponding to narrow-band light passing through a narrow-band filter, from each other, based on an image signal input from an imaging device; a demosaicing unit configured to perform demosaic processing that interpolates one of the plurality of wide-band image signals based on edge information from the narrow-band image signal separated by the separation unit; and an image generation unit configured to generate a wide-band image by using the wide-band image signal interpolated by the demosaic processing performed by the demosaicing unit and generate a narrow-band image by using the narrow-band image signal.

Image processing device, endoscope system, image processing method, and program

A multi-layer image sensor includes: a first image sensor including a first pixel and a second pixel; and a second image sensor including a third pixel and at least one of a fourth pixel and a fifth pixel. The second image sensor has a light receiving surface where the first image sensor is stacked. At least a portion of the fourth pixel is arranged at a position corresponding to a position of the first pixel and at a position overlapping with the first pixel in a stacking direction of the first sensor. At least a portion of the third pixel is arranged at a position corresponding to a position of the second pixel and at a position overlapping with the second pixel in the stacking direction of the first sensor.

Multi-layer image sensor, image processing apparatus, image processing method, and computer-readable recording medium

An imaging device includes: an imaging sensor; a color filter including first band filters and a second band filter configured to transmit narrowband light having a maximum value of a transmission spectrum outside a range of the wavelength band of the light that passes through each first band filter; a first light source unit; a second light source unit configured to radiate light having an upward projecting distribution of a wavelength spectrum in relation to intensity and having a narrowband light spectrum narrower than the broadband; and a control unit configured to cause the first light source unit and the second light source unit to radiate the beams of light simultaneously, wherein a peak wavelength of the light radiated by the second light source unit is an infrared region or a near-infrared region.

Imaging device and capsule endoscope system

An image processing unit has an image acquisition part, a correlation determination part, a reference image generation part, and an interpolation image generation part. The image acquisition part acquires an original image. The correlation determination unit determines whether the correlation of an image component of a primary reference band with image components of respective bands other than the primary reference band is either high correlation or low correlation. The reference image generation part interpolates missing pixels in the image component of the primary reference band by switching the interpolation method based on the correlation determination result obtained by the correlation determination part. The interpolation image generation part interpolates, using the correlation determination result and the primary reference image, missing pixels in at least some of the image component of the primary reference band.

Image processing unit, imaging device, computer-readable medium, and image processing method

An image processing device includes a processor, and the processor acquires a captured image that has been captured using an image sensor, the image sensor including a multi-band color filter array in which color filters that respectively correspond to four or more bands are arranged in an array, generates a low-noise reference image subjected to a noise reduction process as a reference image that is used for an interpolation process that is performed on pixel values of the captured image, and performs the interpolation process on a band basis based on the generated low-noise reference image to generate an interpolated image in which pixel values of missing pixels are interpolated.

Interpolation device, storage medium, and method with multi-band color filter and noise reduced reference image

An image processing device includes: an acquisition unit configured to acquire image data generated by an imaging element where each of narrow band filters constituting a predetermined array pattern is disposed at a position corresponding to any one of a plurality of pixels; a determination unit configured to determine whether or not a light amount of the invisible light range under an environment at the time when the imaging element generates the image data is larger than a threshold value; and a generation unit configured to generate vital information of a subject based on the determination result of the determination unit.

Image processing device, imaging device, image processing method, and computer-readable recording medium

The imaging apparatus includes: a multiband image sensor with a light receiving surface which includes two-dimensional arrays of at least three visible light pixels and an infrared pixels, the visible light pixels having sensitivity in different visible light wavelength ranges, the infrared pixels having sensitivity in the infrared wavelength range; a coded aperture which is disposed on the light receiving surface side of the multiband image sensor and serves as an aperture in a predetermined shape with respect to light in the wavelength range in which the infrared pixel has sensitivity while directly transmitting light in other wavelengths; and a processor for processing an image obtained by the multiband image sensor. The processor generates a depth map based on an image obtained by the multiband image sensor to thereby perform processing of a blurred image.

Imaging apparatus

An imaging device includes: an image sensor that includes a color filter array in which normal image generation color filters corresponding to three or more bands and correction information generation color filters differing in spectral sensitivity characteristics from the normal image generation color filters are placed in an array; a normal image generation section that generates a normal image in which pixel values of missing pixels are interpolated; a spectral estimation section that performs a spectral estimation process based on pixel values obtained using at least the correction information generation color filters; a correction information generation section that generates correction information that corrects the normal image based on a spectral estimate value; and a corrected image generation section that performs a correction process on the normal image based on the correction information to generate a corrected image.

Imaging device and image generation method

An imaging apparatus has a color filter array, an image sensor, and a differential information acquisition unit. In the color filter array, including five or more types of color filters are arranged in a two dimensional form. The image sensor has a plurality of pixels covered by the color filters, and the plurality of pixels generate pixel signals. The acquisition unit designates one of the pixels covered by the color filters of interest as a pixel of interest one pixel at a time in order. The acquisition unit calculates first differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the first direction. The acquisition unit calculates second differential information based on pixel signals generated by two of the pixels arranged on both sides of the pixel of interest along the second direction.

Imaging apparatus with plural color filters and image processing

An image processing device includes: an image acquisition section that acquires captured image data captured using an image sensor including color filters corresponding to bands, and corresponding to a plurality of frames; an alignment processing section that performs an alignment process on the captured image data to generate integrated captured image data; a reference band selection section that selects a reference band from the bands using an output image in a preceding frame; a reference image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to the reference band; and an interpolated image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to a band differing from the reference band based on a reference image to generate an interpolated image.

Image processing device to generate an interpolated image that includes a large amount of high-frequency component and has high resolution, imaging device, image processing method, and information storage device

The color filter arraycomprises seven or more types of color filters including a first color filter. The seven or more types color filters have different spectral sensitivity characteristics. The seven or more types of color filters are arranged in a two-dimensional form. Among the seven or more types of color filters, at least two types of color filters are designated as a color filter of interest. Two color filters arranged at a first interval on both sides of the color filter of interest along a first direction are of the same type. Two color filters arranged at a second interval on both sides of the color filter of interest along a second direction that is different from the first direction are of the same type. Among the color filters, at least one type of color filter have a density higher than that of the other types of color filters, thereby realizing acquisition of highly accurate gradient information from a multiband color filter array.

Growing community of inventors

Akiruno, Japan

Sunao Kikuchi