Google Inc.

Adobe, Inc.

Synopsys, Inc.

Tilman Reinhardt

Brian Gammon Brown

Zhe Fan

Matthew Robert Simpson

Michael Hongmai Lin

Mark A Limber

Robert Seidl

Joshua Sam Schpok

Andrew Timothy Szybalski

Stephane Lafon

Scott Hamilton Shattuck

Aleksey Golovinskiy

Matt Lowrie

Xiaolin Wei

David Robert Gallup

Brett Allen

Matthew W Lowrie

Jeremiah Childs

Michael Hongnai Lin

The present invention pertains to geographical image applications. A user may transition between nadir and street level imagery using unstitched oblique imagery. Oblique images offer a rich set of views of a target location and provide a smooth transition to or from other images such as nadir photographs taken by satellites or street level photographs taken by ground level users. Using unstitched oblique images avoids artifacts that may be introduced when stitching together one or more images. This allows an application to display images to a user and create the illusion of three dimensional motion.

Interactive geo-referenced source imagery viewing system and method

Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.

Interface for applying a photogrammetry algorithm to user-supplied photographic images

Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, determining a correlation between a pose of a first camera and a pose of a second camera, generating one or more constraints incorporating the correlation, and determining at least one of camera parameters and three dimensional locations of features using a plurality of constraints including the generated one or more constraints. The first camera and the second camera have substantially rigid positions and poses relative to each other. A strength of the correlation is based at least upon a time interval between respective image captures by the first camera and the second camera.

Bundle adjustment based on image capture intervals

Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, detecting features in the plurality of images where each of the images cover at least a portion of the geographic area, comparing the detected features between respective ones of the images to determine a plurality of matched features, selecting a subset of the plurality of matched features, and determining the camera parameters and the three dimensional positions of one or more of the detected features using the selected subset. The respective matched features are selected depending on a quantity of other matched features in proximity to the respective matched features.

Feature reduction based on local densities for bundle adjustment of images

Systems and methods for generating textures to be rendered in conjunction with a polygon mesh are provided. More particularly, a polygon mesh modeling a geographic area can be accessed. A plurality of source images depicting the geographic area can then be identified. The plurality of source images can be aligned to reduce projection misalignments between source images when the source images are projected to the polygon mesh. A texture can then be determined based at least in part on a weighted average of pixels in the plurality of source images corresponding to a point on the surface of the polygon mesh. Determining a texture can include removing at least one outlier pixel associated with a moving object from the weighted average.

Multiview texturing for three-dimensional models

A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.

Photo-image-based 3D modeling system on a mobile device

Methods, systems, and computer program products are provided for determining camera parameters and three dimensional locations of features from a plurality of images of a geographic area. These include, detecting features in the plurality of images where each of the images cover at least a portion of the geographic area, comparing the detected features between respective ones of the images to determine a plurality of matched features, selecting a subset of the plurality of matched features and determining the camera parameters and the three dimensional positions of one or more of the detected features using the selected subset. The respective matched features are selected depending on a quantity of other matched features in proximity to the respective matched features.

Embodiments improve pose data for images via user interaction. A user may model a building in a web browser plug in by mapping positions on two-dimensional images to a three-dimensional model of a building shown in the image. Each of the images may have associated original pose data, which includes information related to a position and orientation of a camera which took the image. Upon modeling the building, pose data may be adjusted to more accurately depict the building as a three-dimensional model. If the adjusted pose data is superior to the original pose data, the adjusted pose data may be associated with the image.

Growing community of inventors

Woodside, CA, United States of America

Tilman Reinhardt