Google Inc.

Zhe Fan

Tilman Reinhardt

Brian Gammon Brown

Matthew Robert Simpson

Mark A Limber

Scott Hamilton Shattuck

Matt Lowrie

Matthew W Lowrie

Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.

Interface for applying a photogrammetry algorithm to user-supplied photographic images

A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.

Photo-image-based 3D modeling system on a mobile device

Embodiments improve pose data for images via user interaction. A user may model a building in a web browser plug in by mapping positions on two-dimensional images to a three-dimensional model of a building shown in the image. Each of the images may have associated original pose data, which includes information related to a position and orientation of a camera which took the image. Upon modeling the building, pose data may be adjusted to more accurately depict the building as a three-dimensional model. If the adjusted pose data is superior to the original pose data, the adjusted pose data may be associated with the image.

Pose data via user interaction

Embodiments relate to selecting textures for a panoramic photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a panoramic photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the panoramic photographic image. In the method, a street-level panoramic photographic image is selected by a user from a street-level panoramic image display site. An area of the street-level panoramic image is also identified by the user. A photographic image at the area of the street-level panoramic image is captured. Camera parameters representing a camera that took the photographic image is determined. A position on the photographic image is mapped to a position on a three-dimensional model. The camera parameters are adjusted so that the three-dimensional model is rendered onto the photographic image from a perspective specified by the adjusted camera parameters.

Interface for applying a photogrammetry algorithm to panoramic photographic images

Embodiments relate to modeling three-dimensional interiors from photographic images. In a first embodiment, a computer-implemented method creates a three-dimensional model of an interior of a building from a photographic image. Input data is received from a user specifying a floor plan of the interior of the building. A first constraint input by a user indicating that a position on the floor plan corresponds to a position on the three-dimensional model is received. A second constraint input by a user indicating that a position on a photographic image of the interior corresponds to a position on the three-dimensional model is received. Finally, the three-dimensional model and camera parameters representing a camera that took the photographic image of the interior are altered based on the first and second constraints.

Modeling three-dimensional interiors from photographic images, and applications thereof

Embodiments relate to constructing a three-dimensional model using a plurality of two-dimensional photographic images. In a first embodiment, a first user input specifying a first position on a first photographic image may be received. A second user input specifying a second position on a second photographic image may be received, the second photographic image having a second perspective, specified by a second set of camera parameters, being different from a first perspective of the first image specified by a first set of camera parameters. The user inputs may indicate corresponding features in the images. Using photogrammetry, a point in a three-dimensional space may be determined according to the first position, the second position, the first set of camera parameters, and the second set of camera parameters. A surface of the three-dimensional model may be determined, whereby the surface may be curved to the point in three-dimensional space determined earlier.

Using photographic images to construct a three-dimensional model with a curved surface

Embodiments relate to locking geometric and camera parameters in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method modifies a three-dimensional model using a set of two-dimensional photographic images. In the method, at least one constraint, input by a user, for a two-dimensional photographic image from the set of two-dimensional photographic images are received. Each constraint indicates that a position on the two-dimensional photographic image corresponds to a position on the three-dimensional model. When the number of constraints received for the two-dimensional photographic image is less than or equal to a first threshold value, camera parameters representing a camera that took the constrained photographic image. Finally, a photogrammetry algorithm is applied to at least the set of parameters to determine at least one unlocked parameter in the set of parameters and to modify the three-dimensional model based on the constraints.

Locking geometric and camera parameters in image-based three-dimensional modeling, and applications thereof

Embodiments relate to selecting and verifying textures in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method for texturing a three-dimensional model. In the method, a polygon orientation of a polygon defining a face of a three-dimensional model is determined. A first camera orientation corresponding to a camera that took a first photographic image in a set of photographic images is also determined. The first photographic image is unconstrained to the three-dimensional model. The polygon orientation is compared with the first camera orientation to determine whether the first photographic image is directed toward the face of the three-dimensional model. If the first photographic image is directed toward the face of the three-dimensional model, a notification is provided for display to a user indicating that the first photographic image could be texture mapped to the three-dimensional model if the first photographic image is constrained to the three-dimensional model.

Growing community of inventors

Boulder, CO, United States of America

Zhe Fan