Gentech Corporation

Massachusetts Institute of Technology

Cognitens Ltd.

Amnon Shashua

Tomaso A Poggio

David J Beymer

An arrangement for generating reconstructon information to facilitate reconstruction of three-dimensional features of objects in a scene based on two-dimensional images of the scene taken from a plurality of locations. The arrangement includes a plurality of elements including an epipole generating means, a homography generating means and a depth value generating means. The epipole generating means identifies the location of epipoles, that is, the coordinates in each image plane, in which the images were recorded, of the point of intersection of the line interconnecting the centers of projection of the image recorders that record the images. The homography generating means uses the epipoles and the coordinates in the respective images of selected reference points to generate a homography that relates the coordinates of all points in the images. Finally the depth value generating means uses the homography generated by the homography generating means and the coordinates of the projection of at least one other point, other than the selected reference points, in the images to generate, for generating a depth value representative of the distance of the other point relative to the location of at least one of the image recorders. Using the depth values generated for an number of points of objects in the scene and the coordinates of the projections of the points in at least one of the image planes, as determined from the images, the three-dimensional (Euclidean) structures of the objects can be determined.

System and method for reconstructing surface elements of solid objects

Synthesis of novel images from example images is achieved by determining a pixelwise optical flow among example images, computing a parameter set for a new image, and synthesizing the new image based on the parameter vector and the example images. The parameter set may describe characteristics of the image, in which case the characteristics are applied to a neural network trained with the example images in order to synthesize the novel image. The parameter set may also be an estimate of relative contributions of each of the example images to the new image, in which case the new image may be synthesized by taking a linear combination of the example images, weighted by the parameter set. In one embodiment, both the example and the new images are of the same object. In another embodiment, the example image represents a first object while the new image represents a second object. In yet another embodiment, a set of target images is synthesized from a single target image and a set of source images. Analysis of existing images to determine image parameters is achieved by determining parameters for the existing image based on comparison of the existing image with an image set for which parameters are known.

Example-based image analysis and synthesis using pixelwise correspondence

An image processing system comprising and image recording system and an image rendering system. The image recording system records images of a scene, and comprises a recording device for recording images of the scene on a series of frames, each frame including image information reflecting the scene as illuminated at the time the frame was recorded, a plurality of individually-energizable light sources each for illuminating the scene; and a synchronizer connected to the recording device and the light sources for synchronizing the separate energization of the light sources and the recording by the recording device of the separate frames in the series. The image rendering system generates a rendered image which reflects a desired light source position. The image rendering system specifically comprises a frame store for storing the image information for each of the series of frames, a rendered image store for receiving rendered image information a rendered image a rendered image information generator for generating rendered image information for storage in response to image information from the frame store related to frames of the series as recorded in synchrony with diverse ones of the light sources, the rendered image information generator generating the rendered image information in relation to the image information of each of the frames, as weighted in relation to the relationship between the position of the light sources in synchrony with which the frame was recorded and the desired position of the light source for the rendered image.

Growing community of inventors

Cambridge, MA, United States of America

Amnon Shashua