Hover, Inc.

William Castillo

Manish Upendran

Adam J Altman

Ajay Mishra

Derek Halliday

Giridhar Murali

Ioannis Pavlidis

Matthew Thomas

Brandon Scott

Sarthak Sahu

Jeffrey Sommers

Dario Rethage

Yunwen Zhou

Jena Dzitsiuk

Kai Jia

Francisco Avila-Beltran

David Royston Cutts

A J Altman

Domenico Curro

Atulya Shree

Panfeng Li

Alrik Firl

Jonathan Mark Igner

Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.

Real-time processing of captured building imagery

System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining images of the building structure, including non-camera anchors. The method also includes identifying reference poses for images based on the non-camera anchors. The method also includes obtaining world map data including real-world poses for the images. The method also includes selecting candidate poses from the real-world poses based on corresponding reference poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on correlating the reference poses with the selected candidate poses. Some implementations use structure from motion techniques or LiDAR, in addition to augmented reality frameworks, for scaling the 3-D representations of the building structure. In some implementations, the world map data includes environmental data, such as illumination data, and the method includes generating or displaying the 3-D representation.

3-D reconstruction using augmented reality frameworks

Disclosed are techniques for enhancing two-dimensional (2D) image capture of subjects (e.g., a physical structure, such as a residential building) to maximize the feature correspondences available for three-dimensional (3D) model reconstruction. More specifically, disclosed is a computer-vision network configured to provide viewfinder interfaces and analyses to guide the improved capture of an intended subject for specified purposes. Additionally, the computer-vision network can be configured to generate a metric representing a quality of feature correspondences between images of a complete set of images used for reconstructing a 3D model of a physical structure. The computer-vision network can also be configured to generate feedback at or before image capture time to guide improvements to the quality of feature correspondences between a pair of images.

Techniques for enhanced image capture using a computer-vision network

A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.

Method for generating roof outlines from lateral images

Disclosed are techniques for generating a photorealistic image by augmenting or compositing at least a portion of a physical structure (e.g., a house) depicted in a two-dimensional (2D) image with synthetic image data. Additionally, disclosed are techniques for augmenting the depicted physical structure and applying a scene effect to the synthetic image data to create a photorealistic effect.

Systems and methods for selective image compositing

Systems and methods are disclosed for directed image capture of a subject of interest, such as a physical building. Directed image capture can produce higher quality images such as content more centrally located within an image frame (or an associated viewing device or other display), higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) overlaid within an image frame can facilitate quality assessments for the content or the image frame itself, such as for pixel distance of the subject of interest to a centroid of the image frame (or an associated viewing device or other display), or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Directed image capture

Systems and methods are provided for pitch determination. An example method includes obtaining an image depicting a structure, the image being captured via a user device positioned proximate to the structure. The image is segmented to identify, at least, a roof facet of the structure. An eave vector and a rake vector which are associated with the roof facet are determined. A normal vector of the roof facet is calculated based on the eave vector and the rake vector, and compared to a vector indicating a vertical direction such as gravity. The angle made out by the normal and a gravity vector may be utilized to calculate the pitch of the roof facet.

Systems and methods for pitch determination

System and method are provided for scaling a 3-D representation of a building structure. The method includes obtaining world map data including a first track of real-world poses for a plurality of images. The plurality of images comprises non-camera anchors. The method also includes detecting a discrepancy in at least one real-world pose of the first track. The method also includes in response to detecting a discrepancy, generating a new track of real-world poses. The method also includes calculating a scaling factor for a 3-D representation of the building structure based on sampling across a plurality of tracks. The plurality of tracks comprises at least the first track and the new track.

A process for receiving, from a computing device, a series of captured building images. The process continues by processing, in real-time, each building image in the series of captured building images to determine if each building image meets a minimum criterion, wherein the minimum criteria includes applicability to be used in constructing a specific digital multi-dimensional building model. The process continues by aggregating each image meeting the minimum criteria, determining when a base set of building images has been aggregated, wherein the base set of building images includes a threshold number images to model at least a partial multi-dimensional building model representing the series of captured building images, determining one or more facades present in the partial multi-dimensional building model, determining preliminary dimensions for one or more architectural features of the one or more facades and returning, incrementally (in real-time), the preliminary dimensions to the computing device.

Image capture for a multi-dimensional building model

An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.

Automated guide for image capturing for 3D model creation

A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.

Growing community of inventors

Redwood City, CA, United States of America

William Castillo