Google Inc.

Trimble Navigation Limited

Brian Gammon Brown

Tilman Reinhardt

Zhe Fan

Matthew Robert Simpson

Mark A Limber

Paul McLean

Preston Jackson

John M Bacus

Scott Hamilton Shattuck

Jeffrey Hauswirth

Patrick Lacz

Brian Edmond Brewington

Dale Kris Hawkins

James Anthony Guggemos

Bryce Stout

Jeff Hauswirth

Matt Lowrie

Matthew W Lowrie

Dale Hawkins

Embodiments relate to selecting textures for a user-supplied photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a user-supplied photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the user-supplied photographic image. In the method, a user-supplied photographic image inputted by a user is received. A set of geographic characteristics inputted by the user that correspond to a geographic location of a camera that took the user-supplied photographic image is received. A plurality of camera parameters that correspond to the geographic location of the camera that took the user-supplied photographic image is determined. The user-supplied photographic image to be texture mapped to the three-dimensional model is enabled.

Interface for applying a photogrammetry algorithm to user-supplied photographic images

A method in a computing device for generating a composite document includes receiving drawing data from a user interface, where the drawing data includes a plurality of two-dimensional shapes, and generating a first data structure that includes the received drawing data. The method further includes receiving a reference to a geographic location from the user interface and, in response to receiving the reference to the geographic location, retrieving photograph data corresponding to the received reference, where the photograph data includes at least one of satellite image data and aerial image data for the geographic location.

Managing satellite and aerial image data in a composite document

Systems, methods and articles of manufacture for editing element attributes of a design within a user interface view are described herein. Embodiments of the present invention relate to reducing or eliminating the effort a user must put forth in editing attributes of a user specified element in moving from the user specified element in a main document window of the user interface to the far end of the main document window and then combing within a dense menu displaying every attribute for every element supported by the user interface. Further embodiments allow a user to easily filter through the dense menu displaying every attribute for every element to find the attributes that are specific to the element selected and do so without having to go to the dense menu displayed on the far side of the main document window. In one embodiment, this is achieved by displaying only the attributes specific to the user selected element in a user interactive palette where the user interactive palette is displayed in close proximity to the user selected element in the main document window. Each time a user selects an element a different user interactive palette will appear displaying the attributes specific to the user selected element and in close proximity to that element.

Editing element attributes of a design within the user interface view, and applications thereof

A system that runs in web browsers of mobile devices that allows mobile users to take photos of building exteriors and interiors or other real world objects, upload photos, share photos with others, and use the photo images to model the 3D models with the system's image-based modeling interface.

Photo-image-based 3D modeling system on a mobile device

A computer-aided design system and method facilitates the editing of an object in a workspace of a computer aided design system. A user input indicating selection of an affine tool is received, and a user input indicating selection of the object is received. It is determined whether an additional user input is received. If it is determined that the additional user input is not received, a first set of user-activatable affine functions for manipulating the object is enabled. The first set of user-activatable affine functions includes a move function to move the object in the workspace and a resize function to resize the object. If it is determined that the additional user input is received, a second set of user-activatable functions for manipulating the object is enabled. The second set of user-activatable affine functions includes a skew function to skew the object.

Multi-function affine tool for computer-aided design

A composite document system is implemented as instructions stored on a computer-readable medium. When executed on a processor, the instructions cause the processor to receive model data that describes a three-dimensional model of an object, where the three-dimensional model is generated using a modeling software, and where the model data conforms to a non-image format of the modeling software. The instructions further cause the processor to receive web page data that includes content and description of the content in a mark-up language, generate a composite document that includes the model data and the web page data, interpret the model data in the composite document to generate a visual representation of the three-dimensional model, and interpret the web page data in the composite document to generate a visual representation of the web page data.

Managing web page data in a composite document

Aspects of the invention relate generally to ranking geographic locations based on perceived user interest. More specifically, a database of three-dimensional models of buildings or other architectural features may be used to determine the level of user interest in a particular location and accordingly rank, for example, geographic locations or web or map search results with local intent. For example, various signals such as the number of models created by users for a particular location, the number of clicks or requests for the models of the particular location, the number of POIs contained within or associated with the models associated with the particular geographic location, number of categories associated with a model associated with the geographic location, number of embedded views or views of the models associated with the particular location on other web sites, and the age of the models associated with the particular geographic location.

Augmentation of place ranking using 3D model activity in an area

A system and method for dynamically linking or connecting annotations to embedded content, such as a 3D model, using graphical elements within a two-dimensional space is provided. Such connection is maintained as the annotation is rendered with the 3D model, thereby enabling the annotations to intelligently update themselves using 3D information from the embedded content. Further, the capability, as provided herein, to manipulate viewing positions and perspective effects of an embedded 3D model without disrupting the annotations in the two-dimensional page layout provides a greater degree of flexibility and forgiveness.

Maintaining connection to embedded content using graphical elements

Embodiments improve pose data for images via user interaction. A user may model a building in a web browser plug in by mapping positions on two-dimensional images to a three-dimensional model of a building shown in the image. Each of the images may have associated original pose data, which includes information related to a position and orientation of a camera which took the image. Upon modeling the building, pose data may be adjusted to more accurately depict the building as a three-dimensional model. If the adjusted pose data is superior to the original pose data, the adjusted pose data may be associated with the image.

Pose data via user interaction

Embodiments relate to selecting textures for a panoramic photographic image in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method includes a method for inputting a panoramic photographic image that uses a photogrammetry algorithm to adjust a plurality of camera parameters for the panoramic photographic image. In the method, a street-level panoramic photographic image is selected by a user from a street-level panoramic image display site. An area of the street-level panoramic image is also identified by the user. A photographic image at the area of the street-level panoramic image is captured. Camera parameters representing a camera that took the photographic image is determined. A position on the photographic image is mapped to a position on a three-dimensional model. The camera parameters are adjusted so that the three-dimensional model is rendered onto the photographic image from a perspective specified by the adjusted camera parameters.

Interface for applying a photogrammetry algorithm to panoramic photographic images

Embodiments relate to modeling three-dimensional interiors from photographic images. In a first embodiment, a computer-implemented method creates a three-dimensional model of an interior of a building from a photographic image. Input data is received from a user specifying a floor plan of the interior of the building. A first constraint input by a user indicating that a position on the floor plan corresponds to a position on the three-dimensional model is received. A second constraint input by a user indicating that a position on a photographic image of the interior corresponds to a position on the three-dimensional model is received. Finally, the three-dimensional model and camera parameters representing a camera that took the photographic image of the interior are altered based on the first and second constraints.

Modeling three-dimensional interiors from photographic images, and applications thereof

Embodiments relate to constructing a three-dimensional model using a plurality of two-dimensional photographic images. In a first embodiment, a first user input specifying a first position on a first photographic image may be received. A second user input specifying a second position on a second photographic image may be received, the second photographic image having a second perspective, specified by a second set of camera parameters, being different from a first perspective of the first image specified by a first set of camera parameters. The user inputs may indicate corresponding features in the images. Using photogrammetry, a point in a three-dimensional space may be determined according to the first position, the second position, the first set of camera parameters, and the second set of camera parameters. A surface of the three-dimensional model may be determined, whereby the surface may be curved to the point in three-dimensional space determined earlier.

Using photographic images to construct a three-dimensional model with a curved surface

Embodiments relate to locking geometric and camera parameters in image-based three-dimensional modeling. In a first embodiment, a computer-implemented method modifies a three-dimensional model using a set of two-dimensional photographic images. In the method, at least one constraint, input by a user, for a two-dimensional photographic image from the set of two-dimensional photographic images are received. Each constraint indicates that a position on the two-dimensional photographic image corresponds to a position on the three-dimensional model. When the number of constraints received for the two-dimensional photographic image is less than or equal to a first threshold value, camera parameters representing a camera that took the constrained photographic image. Finally, a photogrammetry algorithm is applied to at least the set of parameters to determine at least one unlocked parameter in the set of parameters and to modify the three-dimensional model based on the constraints.

Growing community of inventors

Longmont, CO, United States of America

Brian Gammon Brown