Sony Corporation

Sony Semiconductor Solutions Corporation

Sony Group Corporation

Teppei Kurita

Shun Kaizu

Yasutaka Hirasawa

Yuhi Kondo

Tomoo Mitsunaga

Ying Lu

Toru Nishi

Daisuke Iso

Hideshi Yamada

Kensei Jo

Tuo Zhuang

Hajime Mihara

Takefumi Nagumo

Shinichiro Gomi

Satoru Takeuchi

Hideki Oyaizu

Hiroaki Takahashi

Yasushi Saito

Masanori Kasai

Kei Nakagawa

Tomonori Masuno

Yoshikuni Nomura

Toshinori Ihara

Legong Sun

Shun Li

Provided is an information processing device that includes a control unit. The control unit acquires a captured image of a target imaged by a sensor. The captured image is an image obtained from reflected light of light emitted to the target from a plurality of light sources arranged at different positions, respectively. The control unit extracts a flat region from the captured image based on a luminance value of the captured image. The control unit calculates shape information regarding a shape of a surface of the target based on information regarding the sensor and the flat region of the captured image.

Information processing apparatus and information processing method for shape measurement of target

An imaging device includes an imaging unit, a signal separating unit, a normal line calculating unit, and a distance estimation unit. The imaging unit includes a plurality of polarization lights having different polarization directions of light emitted to a subject and a polarization sensor that captures an image of the subject that is simultaneously irradiated with the light from the plurality of polarization lights. The signal separating unit separates pixel signals corresponding to each of the polarization directions from the image captured by the imaging unit and generates an image for every polarization direction. The normal line calculating unit calculates a normal line on a surface of the subject from the image for each of the polarization directions by photometric stereo. The distance estimation unit estimates the shape of the subject based on the normal line calculated by the normal line calculating unit.

Imaging device, information processing device, imaging method, and information processing method

An information generation unitacquires, from a polarization imaging unit, observation values in which polarization directions are at least three or more directions (m≥3). A noise amount calculation unit-calculates an amount of noise on the basis of an observation value in a first polarization direction. Similarly, noise amount calculation units-to-calculate amounts of noise on the basis of observation values in second to m-th polarization directions. A polarization model estimation unitestimates a polarization model by using the observation values for the respective polarization directions and the amounts of noise calculated by the noise amount calculation units-to-. Thus, it is possible to calculate a polarization model that is robust against noise.

Information generation device, information generation method and program

A polarization imaging unitacquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unitsets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unitreduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information. An information decoding unitapplies a decoding process corresponding to the compression process of the information compression unitto the compressed image information acquired through a recording mediumor a transmission pathto generate the polarized image and outputs the polarized image to a polarized image using unit

Image processing apparatus, image processing method, and program

A polarization imaging unit generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit of an information processor performs interpolation processing using the polarization image obtained from the polarization imaging unit, and generates a polarization image for each polarization method. A polarization degree calculation unit calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like. A polarization degree correction unit serves as an information correction unit, and corrects, according to the noise amount calculated by the noise amount calculation unit, the polarization degree that is object surface information calculated by the polarization degree calculation unit.

Information processing apparatus and method for processing information

A polarized image acquisition sectionacquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section-calculates the average brightness &#x3b1; of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section-calculates the amplitude &#x3b2; of the polarization model on the basis of the calculated average brightness &#x3b1;, pre-stored information regarding the zenith angle &#x3b8; of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section-is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase &#x3d5; of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness &#x3b1;, and the amplitude &#x3b2; of the polarization model.

Image processing device and image processing method

An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.

Image processing apparatus, image processing method, and solid-state imaging apparatus to detect polarization properties of each color

A polarization imaging sectionincludes polarized pixels in each of a plurality of polarization directions. The polarization imaging sectionincludes a polarizer. The polarization imaging sectionoutputs image signals of a polarized image to a defect detecting sectionof an image processing section. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting sectiondetermines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.

Image processing apparatus and image processing method

In an image capturing unit, an imaging element has a 4&#xd7;4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4&#xd7;4-pixel area, and are non-polarization pixels. The unpolarized component calculating unitof the image processing unitcalculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit. The diffuse reflection component calculating unitcalculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit

Image capturing device and imaging element, and image processing method

A correction information generation sectionemits measurement light having uniform intensity onto a polarized image acquisition sectionacquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section, the correction information generation sectiongenerates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage sectionto store the generated variation correction information. A correction processing sectionthen corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition sectiondue to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section. Therefore, the polarized image outputted from the correction processing sectionbecomes a high-quality polarized image with, for example, its sensitivity variations corrected.

Image processing device, information generation device, and information generation method

An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.

An image pickup unithas a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unitgenerates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit. A polarization information generating unitgenerates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.

Image processing apparatus, image processing method, and image pickup device

[Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times. [Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4&#xd7;4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

Image pickup device and method enabling control of spectral sensitivity and exposure time

The present disclosure relates to a shooting device, a shooting method, and a program capable of suppressing shooting of an image including large blurring due to motion of a camera such that an image with less blurring may be shot. The camera motion is detected, a distribution degree of a trajectory of the camera motion based on a camera motion detection result is calculated to be compared with a predetermined threshold, and start and finish of exposure is controlled on the basis of a comparison result. The present disclosure may be applied to the shooting device.

Growing community of inventors

Tokyo, Japan

Teppei Kurita