Google Inc.

Adobe, Inc.

Lytro, Inc.

Captricity, Inc.

Robert E Carroll

Aseem Agarwala

Steven Maxwell Seitz

Maneesh Agrawala

David Robert Gallup

Methods, apparatuses, and embodiments related to aligning an image of a table of a form with an image of a table of a template of the form. Automatically extracting data entered in fields of a table of a form by a user can be aided by matching the form with a template of the form. The form template can have a digitized representation that identifies locations of fields of the form, and that identifies labels of the fields. Matching the form with the form template can enable locations and labels of fields of the form to be identified based on the digitized representation. However, matching the form with the form template may require matching the table of the form with the table of the form template, and matching two tables can be challenging. For example, the tables can be rotated, warped, scaled, etc. relative to each other.

Aligning grid lines of a table in an image of a filled-out paper form with grid lines of a reference table in an image of a template of the filled-out paper form

This specification describes technologies relating to digital images. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving a source wide-angle image; identifying one or more locally salient features of the source wide-angle image; calculating a mapping from the source wide-angle image to a two-dimensional mapped wide-angle image according to constraints using the identified one or more spatially variable salient features; and rendering the mapped wide-angle image using the calculated mapping such that the mapped wide-angle image reduces distortion of the locally salient features relative to the distortion of the source wide angle image.

Content-aware wide-angle images

Methods, systems, and articles of manufacture for generating a panoramic image of a long scene, are disclosed. These include, fitting a plurality of planes to 3D points associated with input images of portions of the long scene, where one or more respective planes are fitted to each of a ground surface, a dominant surface, and at least one of one or more foreground objects and one or more background objects in the long scene, and where distances from the 3D points to the fitted planes are substantially minimized. These also include, selecting, for respective one or more pixels in the panoramic image of the long scene, one of the input images and one of the fitted planes such that a distance is substantially minimized from the selected one of the fitted planes to a surface corresponding to the respective one or more pixels and occlusion of the respective one or more pixels is reduced in the selected one of the input images; and stitching the panoramic image of the long scene by projecting, for the respective one or more pixels in the panoramic image of the long scene, the selected one of the input images using the selected one of the fitted planes into the virtual camera.

Multiplane panoramas of long scenes

According to various embodiments, the system and method disclosed herein process light-field image data so as to mitigate or remove the effects of pixel saturation in light-field images. A light-field image may be captured with a light-field image capture device with a microlens array. The light-field image may be demodulated, and then a recovered value for each saturated pixel of the demodulated light-field image may be obtained. This may be done by comparing a saturated value of each saturated pixel with reference values of reference pixels proximate the saturated pixel and, if the proximate pixels have a higher reference value than the saturated value, setting the saturated pixel to the reference value. This process may be carried out iteratively until recovered values are obtained for the saturated pixels. A demodulated, saturation-recovered light-field image may then be generated and displayed with the recovered values for the saturated pixels.

Saturated pixel recovery in light-field images

Methods, systems, and articles of manufacture for generating a panoramic image of a long scene are disclosed. These include, fitting planes to 3D points associated with input images of portions of the long scene, where respective planes are fitted to a ground surface, a dominant surface, and at least one of foreground objects and background objects, and where distances from the 3D points to the fitted planes are minimized. These also include, selecting, for respective pixels in the panoramic image, an input image and a fitted plane such that a distance is minimized from the selected the fitted plane to a surface corresponding to the pixels and occlusion of the pixels is reduced in the selected input image, and stitching by projecting the selected input image using the selected fitted plane into the virtual camera.

Growing community of inventors

San Francisco, CA, United States of America

Robert E Carroll