Pointivo, Inc.

Other

Metalforming, Inc.

Habib Fathi

Daniel L Ciprari

William Wilkins

Bradden John Gross

Miguel Serrano

Iven Connary

Jacob B Garland

Guy Ettinger

Geoffrey Louis Stone

William Gaither Wilkins

Ioannis Brilakis

The systems and methods herein provide improved methodologies for visualization on a user's display of sensor data (e.g., 2D and 3D information obtained from or derived from sensors) for objects, components, or features of interest in a scene. The previously acquired sensor data is processable for concurrent display of objects/features/scene or location visualizations to a user during their real-time navigation of a scene camera during a variety of user visualization activities. Sensor data can be acquired via the operation of vehicles configured with one or more sensors, such as unmanned aerial vehicles, or from other methodologies, or from any other suitable sensor data acquisition activities. Objects etc. for which acquired sensor data can be visualized by a user on a display includes buildings, parts of buildings, and infrastructure elements, among other things. The improved display of information to a user for visualization and information generation therefrom provides significant benefits over prior art display methodologies and exhibits notable utility for user activities such as, inspection, condition assessment, performance assessment, insurance applications, construction, inventorying, building information modeling, asset management and the like. Information derivable from the methodologies herein can be used for machine learning libraries and digital twin processes.

Systems and methods for generating of 3D information on a user display from processing of sensor data for objects, components or features of interest in a scene and user navigation thereon

Examples of various method and systems are provided for information extraction from scene information. 2D image information can be generated from 2D images of the scene that are overlapping at least part of one or more object(s). The 2D image information can be combined with 3D information about the scene incorporating at least part of the object(s) to generate projective geometry information. Clustered 3D information associated with the object(s) can be generated by partitioning and grouping 3D data points present in the 3D information. The clustered 3D information can be used to provide, e.g., measurement information, dimensions, geometric information, and/or topological information about the object(s). Segmented 2D information can also be generated from the 2D image information. Validated 2D and 3D information can be produced by cross-referencing between the projective geometry information, clustered 3D information, and/or segmented 2D image information, and used to label the object(s) in the scene.

Systems and methods for extracting information about objects from scene information

Various examples are provided for data acquisition, processing, and output generation for use in analysis of a physical asset or a collection of physical assets of interest. In one example, a method includes providing a user information goal including user information for acquisition, processing, or output of data associated with a physical asset or collection of physical assets; and evaluating existing database information to determine whether all or part of the first user information goal can be substantially completed by retrieval and processing of an information set obtainable from existing database information. If the user information goal cannot substantially be completed using the information set, then a data acquisition plan configured to acquire data needed to substantially complete first user information goal can be generated. If the user information goal can be substantially completed using the information set, then the formation set can be processed to provide an output.

In data acquisition, processing, and output generation for use in analysis of one or a collection of physical assets of interest

Various examples are provided related to generation of accurate measurement information for a structure including a building of interest. A single passive image capture device (e.g., handheld devices such as cellular telephones and tablets) can generate two-dimensional (2D) images that overlap with regard to a building element of interest. Processing the 2D images can generate a three-dimensional (3D) digital representation from which accurate building element measurement information can be extracted. The extracted information can be used in applications such as construction/remodeling estimation, 3D model generation, insurance policy underwriting and adjusting, interior design efforts, landscaping, real estate marketing, inventory management and other areas where it can be desirable to obtain information about features and dimensions of one or more features or objects present in the location.

Processing of 2D images to generate 3D digital representations from which accurate building element measurement information can be extracted

The present disclosure relates to improvements in systems and methods in acquiring images via imaging devices, where such imaging devices can be configured, in some implementations, with an unmanned aerial vehicle or other vehicle types, as well as being hand-held. Images are acquired from the imaging devices according to capture plans where useful information types about a structure of interest (or objects, items, etc.) can be derived from a structure image acquisition event. Images acquired from capture plans can be evaluated to generate improvements in capture plans for use in subsequent structure image acquisition events. Capture plans provided herein generate accurate information as to all or part of the structure of interest, where accuracy is in relation to the real-life structure incorporated in the acquired images.

Image acquisition planning systems and methods used to generate information for structures of interest

Various examples are provided related to systems and processes for generating verified wireframes corresponding to at least part of a structure or element of interest can be generated from 2D images, 3D representations (e.g., a point cloud), or a combination thereof. The wireframe can include one or more features that correspond to a structural aspect of the structure or element of interest. The verification can comprise projecting or overlaying the generated wireframe over selected 2D images and/or a point cloud that incorporates the one or more features. The wireframe can be adjusted by a user and/or a computer to align the 2D images and/or 3D representations thereto, thereby generating a verified wireframe including at least a portion of the structure or element of interest. The verified wireframes can be used to generate wireframe models, measurement information, reports, construction estimates or the like.

Methods and systems for wireframes of a structure or element of interest and wireframes generated therefrom

The present disclosure relates to improvements in systems and methods in acquiring images via a imaging devices, where such imaging devices can be configured, in some implementations, with an unmanned aerial vehicle or other vehicle types, as well as being hand-held. Images are acquired from the imaging devices according to capture plans where useful information types about a structure of interest (or objects, items, etc.) can be derived from a structure image acquisition event. Images acquired from capture plans can be evaluated to generate improvements in capture plans for use in subsequent structure image acquisition events. Capture plans provided herein generate accurate information as to all or part of the structure of interest, where accuracy is in relation to the real-life structure incorporated in the acquired images.

The inventions herein relate generally to improvements in the generation of wireframe renderings derived from 2D and/or 3D data that includes at least one structure of interest in a scene. Such wireframe renderings and similar formats can be used in, among other things, 2D/3D CAD drawings, designs, drafts, models, building information models, augmented reality or virtual reality, and the like. Measurements, dimensions, geometric information, and semantic information generated according to the inventive methods can be accurate in relation to the actual structures. The wireframe renderings can be generated from a combination of a plurality of 2D images and point clouds, processing of point clouds to generate virtual/synthetic views to be used with the point clouds, or from 2D image data that has been processed in a machine learning process to generate 3D data. In some aspects, the wireframe renderings are accurate in relation to the actual structure of interest, automatically generated, or both.

Systems and methods for processing 2D/3D data for structures of interest in a scene and wireframes generated therefrom

The disclosure relates to systems and processes for generating verified wireframes corresponding to at least part of a structure or element of interest can be generated from 2D images, 3D representations (e.g., a point cloud), or a combination thereof. The wireframe can include one or more features that correspond to a structural aspect of the structure or element of interest. The verification can comprise projecting or overlaying the generated wireframe over selected 2D images and/or a point cloud that incorporates the one or more features. The wireframe can be adjusted by a user and/or a computer to align the 2D images and/or 3D representations thereto, thereby generating a verified wireframe including at least a portion of the structure or element of interest. The verified wireframes can be used to generate wireframe models, measurement information, reports, construction estimates or the like.

Examples of various method and systems are provided for information generation from images of a building. In one example, 2D building and/or building element information can be generated from 2D images of the building that are overlapping. 3D building and building element information can be generated from the 2D building and/or building element information. The 2D image information can be combined with 3D information about the building and/or building element to generate projective geometry information. Clustered 3D information can be generated by partitioning and grouping 3D data points. An information set associated with the building and/or at least one building element can then be generated.

Systems and methods for generating information about a building from images of the building

The inventions herein relate generally to improvements in photogrammetry and devices suitable for obtaining such improvements. Some embodiments use only a single passive image-capture device to obtain overlapping 2D images, where such images at least partially overlap with regard to at least one object of interest in a scene. Such images can be processed using methods incorporating structure from motion algorithms. Accurate 3D digital representations of the at least one object of interest can be obtained. Substantially accurate measurements and other useful information regarding the at least one object of interest are obtainable from the methodology herein.

Growing community of inventors

Atlanta, GA, United States of America

Habib Fathi