Nec Corporation

Tokyo Institute of Technology

Shuji Senda

Takashi Shibata

Akihiko Iketani

Masayuki Tanaka

Masatoshi Okutomi

Takehito Hayami

Akitake Mitsuhashi

Kyosuke Nishiyama

The present invention provides an information processing device in which a degradation process of an input image is accurately estimated and a dictionary necessary for generating a desired restored image from the input image can be obtained. The information processing device is provided with: an image acquisition means that acquires a plurality of study images and an input image; and an estimation means that, on the basis of similarity between an arbitrary region of the input image and each of a plurality of degradation images in a case where regions of the study images corresponding to the arbitrary region are degraded on the basis of each of the plurality of degradation processes, outputs an estimated degradation process corresponding to the degradation process corresponding to the region of the input image.

Information processing device that implements image processing, and image processing method

An information processing device according to the present invention includes: a proper identifier output unit which outputs proper identifiers for identifying learning images; a feature vector calculation unit which calculates feature vectors of at least a part of patches included in registered patches that are registered in a dictionary for compositing a restored image; and a search similarity calculation unit which calculates a similarity calculation method that classifies the proper identifiers to be given to the registered patches based on the feature vectors.

Information processing device, image processing method and medium

Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image. Each image is dividable into at least three values: a too bright region, an appropriately bright region, and a too dark region, and has a relationship in which a boundary luminance between the too bright region and the appropriately bright region aligns with a boundary luminance between the appropriately bright region and the too dark region in a darker image having an adjacency relationship therewith.

Image processing system

A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.

Multocular imaging system, synthesis process method of acquired images, and program

The present invention provides an image processing device whereby the probability of outputting a restored image which accurately corresponds to an original image which is included in a low-quality input image is improved. This image processing device comprises: an image group generating means for generating, from the input image, using a dictionary which stores a plurality of patch pairs wherein a degradation patch which is a patch of a degraded image wherein a prescribed image is degraded is associated with a restoration patch which is a patch of this prescribed image, a plurality of restored image candidates including a plurality of different instances of content which have a possibility of being the original content of the input image; and an image selection presentation means for clustering the generated plurality of restored image candidates, and selecting and outputting an image candidate on the basis of the result of this clustering.

Image processing device and image processing method

An image processing device according to the present invention includes: a weight calculation unit that determines an area where a feature value of an input image is saved, based on a gradient of a feature value of a pixel of the input image and a direction of the gradient, and calculates a weight for reducing a regularization constraint that is a constraint based on regularization of image processing in the area where the feature value is saved; a regularization term calculation unit that calculates a regularization constraint of a high resolution image restored based on the input image by using the weight; a reconstruction constraint calculation unit that calculates a reconstruction constraint that is a constraint based on reconstruction of the high resolution image; and an image restoring unit that restores the high resolution image from the input image based on the regularization constraint and the reconstruction constraint.

Image processing device, image processing method and medium

An image processing device according to the present invention includes: a patch generation unit which generates an input patch used for comparison on the basis of an input image; a modification parameter estimation unit which estimates a parameter used in blurred modification on the basis of the input image; a blurred image generation unit which generates a blurred image on the basis of a learning image by using the parameter; a patch pair generation unit which generates a patch pair used to compose a restoration image on the basis of the blurred image and the learning image; a selection unit which selects a patch pair used to compose the restoration image on the basis of the input patch; and a composition unit which composes the restoration image on the basis of the patch pair selected by the selection unit.

A dictionary creation device including a blurred image generation unit which outputs a blurred image generated by performing a blurring process to a learning image together with a blur parameter indicating a blurring state of the blurred image, a patch pair generation unit which generates a restoration patch and a blurred patch as a patch pair that is composed of the patches located at the corresponding positions of the learning image and the blurred image, and a registration unit which associates the patch pair with a blur parameter corresponding to the blurred patch in the patch pair and registers them in a dictionary.

Dictionary creation device, image processing device, image processing system, dictionary creation method, image processing method, and program

An automatic projection image correction system () includes: a projection image frame detection unit () that detects straight lines forming a frame of a screen-projected image which is projected onto a screen by a projector from a captured image obtained by capturing the screen-projected image using a camera; and a projector plane parameter estimation unit () that sets coordinate axes to a projector image, which is an original image of the screen-projected image, and the captured image and estimates at least one of a distance between the screen and the projector, an inclination of the screen with reference to an optical axis of the projector, and a zoom ratio of the projector, using an inclination of the optical axes of the projector and the camera, a distance between the optical centers of the projector and the camera, an intrinsic parameter of the camera, coordinate data of the detected straight lines at coordinates of the captured image, and coordinate data of straight lines corresponding to the frame at coordinates of the projector image.

Automatic projection image correction system, automatic projection image correction method, and non-transitory storage medium

An image processing device, which uses a dictionary which stores data of two or over sets which associate a blurred patch of a blurred image generated by blurring a predetermined image with a restoration patch of the predetermined image. The device includes a processor that processes instructions to generate a tentative restored image from the restoration patch selected based on values indicating similarities between plural input patches generated by dividing an inputted input image and the blurred patch. The processor also processes the instructions to generate a tentative patch by dividing the tentative restored image. The processor further processes the instructions to generate a restored image from the restoration patch selected based on a sum of the value indicating the similarity between the input patch and the blurred patch and a value indicating the similarity between the tentative patch and the restoration patch.

Device, method, and computer readable medium for restoring an image

Provided is an image processing device that can bring about the sufficient resemblance between an original image and a restored image obtained corresponding to a low resolution input image. The image processing device includes a means that uses a dictionary for storing data associating deteriorated patches which are from a deteriorated image formed by deteriorating a prescribed image, and restoration patches which are from the prescribed image, and calculates, as a degree-of-similarity between plural input patches generated by dividing an input image and the deteriorated patches, a weighted degree-of-similarity between weighted deteriorated patches and weighted input patches, in which forms of the deteriorated patches and the input patches are reconfigured using a patch weight which is continuous weighting; a means that selects, on the basis of the weighted degree-of-similarity, a restoration patch for each input patch; and a means that combines the restoration patches to generate a restored image.

Image processing system and image processing method

For each pixel of an input image, a direction toward which variation in pixel value between the relevant pixel and its peripheral pixels is largest and an amount of the variation in pixel value are computed, where a direction unit vector that indicates the direction toward which the variation is largest and a variation vector that represents the amount of the largest variation in the pixel value are computed. For each pixel, a regularization strength is computed utilizing the direction unit vector, the variation vector, and a regularization strength computing formula so that the larger the amount of the variation in pixel value toward a direction indicated by the direction unit vector, the less the regularization strength. An optimization function is determined based on the input image and the regularization strength for each pixel thereof and assigns a value for each pixel, by which the determined optimization function has the minimum value, to the corresponding pixel of a restored image to be generated.

Degradation restoration system, degradation restoration method and program

In an image processing apparatus, a conditional probability calculating element calculates the probability of existence of an attribute as to each region in an input degraded image, for each attribute. Optimization function determining element uses a conditional probability calculated by the conditional probability calculating element with regard to each region in the degraded image for each attribute, a-priori knowledge defined as a conditional probability of appearance of an attribute in a region of a candidate of a restored image when there is the attribute in the region, and the input degraded image to determine an optimization function using the candidate of the restored image as a variable and yielding a smaller value as the candidate of the restored image is closer to a true restored image. Restored image determining element adopts the candidate of the restored image with which the optimization function yields a minimum value as the restored image.

Image processing apparatus, image processing method and image processing program

Error-function determining means makes use of a blur function serving as a function representing the degree of blurring of a blurred input image and a geometrical-deformation matrix serving as a matrix for restricting an operation to lay out a 2-dimensional code shown by the input image on cells each serving as a configuration unit of the 2-dimensional code in order to determine an error function serving as a function satisfying a relation that, the smaller the error between the input image and an image obtained by adding geometrical deformations and blurs to a recovered image obtained from a recovering process, the more the approach to a result determined in advance. Pixel-value restricting means determines pixel-value restriction information prescribing a restriction condition for a restriction imposed on a predetermined pixel value obtained from discretization of pixel values of the 2-dimensional code to be recovered. Objective-function determining means makes use of the error function and the pixel-value restriction information as a basis for determining an objective function serving as a function satisfying a relation that, the closer the recovered image to the true image, the more the approach to a result determined in advance. Objective-function optimizing means determines a recovered image optimizing the objective function.

Method and system for recovering a code image including blurring

An image conversion parameter calculation device accurately calculates a conversion parameter for image alignment with a processing amount that does not depend on the size of an image to be aligned. A pixel selection element randomly selects pixels from a predetermined number or pixels of not more than the predetermined number from a first image. A parameter derivation element derives a conversion parameter by performing processing for pixels selected by the pixel selection element, the conversion parameter being a parameter for converting, to the first image, a second image that is subject to image alignment with the first image.

Growing community of inventors

Tokyo, Japan

Shuji Senda