Hover, Inc.

Manish Upendran

Adam J Altman

William Castillo

Ajay Mishra

Derek Halliday

Ioannis Pavlidis

Sarthak Sahu

Matthew Thomas

Yunwen Zhou

Jena Dzitsiuk

A J Altman

Giridhar Murali

Brandon Scott

Dario Rethage

Javier Cambon Sanjurjo

Atulya Shree

Randy Lacasse

Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.

Real-time processing of captured building imagery

System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.

3-D reconstruction using augmented reality frameworks

A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.

Method for generating roof outlines from lateral images

Identifying a pre-existing three-dimensional (3D) model of a target structure includes receiving at least one two-dimensional (2D) image of a target physical structure; generating a predicted 3D model of the target structure based on the at least one 2D image; generating a search descriptor of the predicted 3D model; querying a data structure storing a plurality of pre-existing descriptors, where each pre-existing descriptor characterizes a previously constructed 3D model of an associated physical structure; and identifying at least one previously constructed 3D model that is substantially similar to the predicted 3D model based on a difference between the search descriptor and the plurality of pre-existing descriptors.

Structural modification detection using descriptor-based querying

Systems and methods are disclosed for directed image capture of a subject of interest, such as a physical building. Directed image capture can produce higher quality images such as content more centrally located within an image frame (or an associated viewing device or other display), higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) overlaid within an image frame can facilitate quality assessments for the content or the image frame itself, such as for pixel distance of the subject of interest to a centroid of the image frame (or an associated viewing device or other display), or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Directed image capture

Visualizing three dimensional content is complicated by display platforms capable of more degrees of freedom to display the content than interface tools have to navigate that content. Disclosed are methods and systems for displaying select portions of the content and generating virtual camera positions with associated look angles for the select portions, such as planar geometries of a three dimensional building, thereby constraining the degrees of freedom for improved navigation through views of the content. Look angles can be associated with axes of the content and fields of view.

Method and system for displaying and navigating an optimal multi-dimensional building model

System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining world map data including a first track of real-world poses for a plurality of images. The plurality of images comprises non-camera anchors. The method also includes detecting a discrepancy in at least one real-world pose of the first track. The method also includes in response to detecting a discrepancy, generating a new track of real-world poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on sampling across a plurality of tracks. The plurality of tracks comprises at least the first track and the new track.

A process for receiving, from a computing device, a series of captured building images. The process continues by processing, in real-time, each building image in the series of captured building images to determine if each building image meets a minimum criterion, wherein the minimum criteria includes applicability to be used in constructing a specific digital multi-dimensional building model. The process continues by aggregating each image meeting the minimum criteria, determining when a base set of building images has been aggregated, wherein the base set of building images includes a threshold number images to model at least a partial multi-dimensional building model representing the series of captured building images, determining one or more facades present in the partial multi-dimensional building model, determining preliminary dimensions for one or more architectural features of the one or more facades and returning, incrementally (in real-time), the preliminary dimensions to the computing device.

Image capture for a multi-dimensional building model

Systems and methods are disclosed for adjusting plane positions in multi-dimensional models. Disclosed is moving a plane associated with an architectural element based on a scale and a translation positional error, wherein the scaled is determined based on the architectural element, and the translation position error is based on a position of the architectural element, and reconstructing the multi-dimensional building model based on the moved plane.

Multi-dimensional model reconstruction

An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.

Automated guide for image capturing for 3D model creation

A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.

Growing community of inventors

San Francisco, CA, United States of America

Manish Upendran