The Boeing Company

John H Aughey

Carl J Vorst

Michael V Rohr

Steven D Swaine

Robert J Klein

Zachary L Langford

David D Fries

Described herein is a method of generating an image that includes receiving a set of data corresponding to an object. The method also includes generating a three-dimensional representation of the object using the set of data. The method includes generating properties for the object using the set of data. The method also includes associating the properties with the three-dimensional representation of the object, wherein the three-dimensional representation of the object and the properties for the object are used to produce training data for an object recognition algorithm.

Apparatus, system, and method for generating an image

A camera pose estimation system is provided for estimating the position of a camera. The system may be configured to receive a 2D image of at least a portion of a structure captured by a camera, and produce an annotated 2D image in which a plurality of architecture features of the structure in the 2D image are overlaid with a corresponding plurality of geometric features. A synthetic camera may be positioned at a particular position, and a synthetic 2D image of at least a portion of a 3D model of the structure may be rendered by the synthetic camera. An amount of error in the particular position of the synthetic camera based on the annotated 2D image and synthetic 2D image may be calculated.

Structure-based camera pose estimation system

A camera pose estimation system is provided for estimating the position of a camera within an environment. The system may be configured to receive a 2D image captured by a camera within the environment, and interpret metadata of the 2D image to identify an estimated position of the camera. A synthetic 2D image from a 3D model of the environment may be rendered by a synthetic camera within the model at the estimated position. A correlation between the 2D image and synthetic 2D image may identify a 2D point of correlation, and the system may project a line from the synthetic camera through the 2D point on the synthetic 2D image rendered in an image plane of the synthetic camera such that the line intersects the 3D model at a corresponding 3D point therein. A refined position may be determined based on the 2D point and corresponding 3D point.

Pattern-based camera pose estimation system

A camera pose estimation system is provided for estimating the position of a camera within an environment. The system may be configured to receive a 2D image captured by a camera within the environment, and interpret metadata of the 2D image to identify an estimated position of the camera. The 2D image may be registered within a 3D model of the environment, and more particularly, registered within the image plane of a synthetic camera within the model at the estimated position. A 3D point within the 3D model that has a corresponding 2D point on the 2D image may be identified. The synthetic camera and thereby the image plane and 2D image may be repositioned to a new position at which a projection line from the synthetic camera and through the corresponding 2D point intersects the corresponding 3D point, the new position being a refined position of the camera.

Optimized camera pose estimation system

A system and method for 3-D environment manipulation is disclosed. A vector extrapolator is configured to extrapolate an input into a 3-D space to establish a 3-D vector extrapolation. A perspective locator is configured to relocate a viewing perspective based on the 3-D vector extrapolation.

System and method for navigating a 3-D environment using a multi-input interface

A system for tracking a gaze of an operator includes a head-mounted eye tracking assembly, a head-mounted head tracking assembly and a processing element. The head-mounted eye tracking assembly comprises a visor having an arcuate shape including a concave surface and an opposed convex surface. The visor is capable of being disposed such that at least a portion of the visor is located outside a field of view of the operator. The head-mounted head tracking sensor is capable of repeatedly determining a position of the head to thereby track movement of the head. In this regard, each position of the head is associated with a position of the at least one eye. Thus, the processing element can repeatedly determine the gaze of the operator, based upon each position of the head and the associated position of the eyes, thereby tracking the gaze of the operator.

Growing community of inventors

Richmond Heights, MO, United States of America

John H Aughey