Sony Corporation

Sony Group Corporation

Yuhi Kondo

Yasutaka Hirasawa

Ying Lu

Hideki Oyaizu

Teppei Kurita

Suguru Aoki

Taketo Akama

Shun Kaizu

Takefumi Nagumo

Legong Sun

Jun Luo

Tuo Zhuang

Ayaka Nakatani

Taishi Ono

Hajime Mihara

Kengo Hayasaka

Hiroaki Takahashi

Akihiko Kaino

Tomonori Masuno

Toshinori Ihara

Sayaka Watanabe

Satoru Takeuchi

Provided is a polarization rendering setting unit that sets a plurality of parameters to be used for generating a polarized rendered image of an abnormality detection target. A polarized rendered image generation unit generates the polarized rendered image of the abnormality detection target on the basis of the parameters set by the polarization rendering setting unit. An abnormality detection unit detects an abnormal region of the abnormality detection target on the basis of a difference between a polarized captured image acquired by imaging the abnormality detection target and the polarized rendered image generated by the polarized rendered image generation unit. Abnormalities that are difficult to detect on the basis of luminance information and color information becomes able to be detected on the basis of polarized images.

Information processing device and information processing method

A same region detector detects a same region of a processing target for each of a plurality of different viewpoints from polarization images in a plurality of polarization directions acquired for each of the viewpoints. The polarization images in the plurality of polarization directions acquired for each of the plurality of different viewpoints are, for example, polarization images acquired by imaging over a period of a plurality of frames in which a positional relationship between the processing target and a polarization image acquisition unit that acquires the polarization images changes. A polarization degree calculation unit calculates a polarization degree of the same region for each of the viewpoints on the basis of the polarization images in the plurality of polarization directions. A reflection removal unit performs reflection removal processing on the same region of the processing target by using the polarization images in the plurality of polarization directions of the viewpoint at which the polarization degree calculated by the polarization degree calculation unit is maximized. A reflection component can be removed even when an angle between a plane direction of a reflecting surface and an imaging direction is not clear.

Image processing apparatus and image processing method which performs reflection removal processing by using polarization images

An imaging apparatus () includes an imaging unit () that has a first pixel block and a second pixel block provided in a pixel region, the first pixel block including polarization pixels with two different polarization directions and a non-polarization pixel, the second pixel block including polarization pixels with a plurality of polarization directions including a different polarization direction from the first pixel block. An image processing apparatus () acquires a captured image generated by the imaging apparatus (), and a correction coefficient calculation unit () calculates a correction coefficient that absorbs a sensitivity difference between polarization pixels and non-polarization pixels, on the basis of an image of the second pixel block. A polarization information generation unit () generates polarization information indicating the polarization characteristics of the object included in the captured image, using a non-polarization image and polarization component images generated by a demosaicing unit () and the correction coefficient calculated by the correction coefficient calculation unit (). The correction coefficient of the sensitivity difference between the polarization pixels and the non-polarization pixels can be acquired without any calibration.

Imaging apparatus, image processing apparatus, and image processing method

A polarization imaging unitacquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unitsets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unitreduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information. An information decoding unitapplies a decoding process corresponding to the compression process of the information compression unitto the compressed image information acquired through a recording mediumor a transmission pathto generate the polarized image and outputs the polarized image to a polarized image using unit

Image processing apparatus, image processing method, and program

An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a prediction unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The prediction unit predicts an action of the target object on a basis of the estimated posture.

Information processing apparatus and information processing method

A polarization imaging unit generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit of an information processor performs interpolation processing using the polarization image obtained from the polarization imaging unit, and generates a polarization image for each polarization method. A polarization degree calculation unit calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like. A polarization degree correction unit serves as an information correction unit, and corrects, according to the noise amount calculated by the noise amount calculation unit, the polarization degree that is object surface information calculated by the polarization degree calculation unit.

Information processing apparatus and method for processing information

A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.

Damage reduction device, damage reduction method, and program

The invalid pixel detection unitdetects an invalid pixel from a non-polarized image and a plurality of polarized images for different polarization directions obtained by performing image pickup using the polarization image pickup unit. For example, the invalid pixel detection unitdetects a saturated pixel having a pixel value larger than a preset saturation detection threshold and a black-crushed pixel having a pixel value smaller than a preset black crushing detection threshold as invalid pixels from a non-polarized image. The polarization information generation unitperforms processing of generating polarization information on the basis of the non-polarized image and polarized images and switches the processing of generating the polarization information depending on the detection result of the invalid pixels in the invalid pixel detection unit, so as to generate the polarization information without using the invalid pixels. Correct polarization information can be acquired.

Image processing device, image processing method, and image pickup device

A normal candidate information generation unit of an information processor generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit. The in-plane pixel selection unit selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit.

A polarized image acquisition sectionacquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section-calculates the average brightness &#x3b1; of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section-calculates the amplitude &#x3b2; of the polarization model on the basis of the calculated average brightness &#x3b1;, pre-stored information regarding the zenith angle &#x3b8; of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section-is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase &#x3d5; of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness &#x3b1;, and the amplitude &#x3b2; of the polarization model.

Image processing device and image processing method

Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.

Information processing apparatus, information processing method, and calibration apparatus

An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.

Image processing apparatus, image processing method, and solid-state imaging apparatus to detect polarization properties of each color

A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.

Imaging device, image processing device and image processing method

A polarization imaging sectionincludes polarized pixels in each of a plurality of polarization directions. The polarization imaging sectionincludes a polarizer. The polarization imaging sectionoutputs image signals of a polarized image to a defect detecting sectionof an image processing section. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting sectiondetermines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.

Growing community of inventors

Tokyo, Japan

Yuhi Kondo