The Boeing Company

Paul S Idell

David Roderick Gerwe

Justin Cleve Hatcher

Yifan Yang

James L Clayton

Richard B Holmes

Jacob A Lucas

Kevin R Paxton

Trent M Kyono

Friedrich Wilhelm Kunzler

Nicole Catherine Gagnier

Jeffrey H Hunt

Deepak Khosla

Leon Nguyen

Fan Hin Hung

Brandoch Calef

William Kentarou Kaneko Leach

Jacob Arthur Lucas

James Lee Clayton

A method includes providing an image to a feature extraction model to generate feature data. The image depicts a portion of a first device and a portion of a second device. The feature data includes coordinates representing key points of each of the first and second devices depicted in the image. The method also includes obtaining position data indicating a position in 3D space of a connector of the first device. The method further includes providing the feature data and the position data to a trained autonomous agent to generate a proposed maneuver to mate the connector with a connector of the second device.

Autonomous maneuver generation to mate connectors

Aspects of the disclosure provide solutions for automated air-to-air refueling (A3R) and assisted air-to-air refueling. Examples include: receiving a video frame; generating, from the video frame, a plurality of images having differing decreasing resolutions; detecting, within each of the plurality of images, a set of aircraft keypoints for an aircraft to be refueled; merging the sets of aircraft keypoints into a set of merged aircraft keypoints; based on at least the merged aircraft keypoints, determining a position of a fuel receptacle on the aircraft; and determining a position of a boom tip of an aerial refueling boom. Some examples include, based on at least the position of the fuel receptacle and the position of the boom tip, controlling the aerial refueling boom to engage the fuel receptacle, and for some examples, the video frame is monocular (e.g., provided by a single camera).

Feature detection for automated air-to-air refueling (A3R)

Aspects of the disclosure provide fuel receptacle and boom tip position and pose estimation for aerial refueling. A video frame is received and within the video frame, aircraft keypoints for an aircraft to be refueled are determined. Based on at least the aircraft keypoints, a position and pose of a fuel receptacle on the aircraft is determined. Within the video frame, a boom tip keypoint for a boom tip of an aerial refueling boom is also determined. Based on at least the boom tip keypoint, a position and pose of the boom tip is determined. Based on at least the position and pose of the fuel receptacle and the position and pose of the boom tip, the aerial refueling boom is controlled to engage the fuel receptacle. Some examples overlay projections of an aircraft model on displayed video for a human observer.

Fuel receptacle and boom tip position and pose estimation for aerial refueling

A combined multi-spectral and polarization (CMSP) sensor is disclosed that enhances contrast-to-noise ratio (CNR). The CMSP sensor comprises a multi-spectral and polarization (MSP) filter, a single focal plane array (FPA), and a controller. The FPA comprises a plurality of detectors and the MSP filter comprises at least a first bandpass filter having a first frequency range and a second bandpass filter having a second frequency range that is distinct from the first frequency range and a first polarization filter having a first polarization value and a second polarization filter having a second polarization value that is distinct from the first polarization value.

Combined multi-spectral and polarization sensor

Systems and methods that combine forward-model image reconstruction techniques with tomographic estimation of three-dimensional atmospheric turbulence to enable high-quality anisoplanatic imaging and beam control through the atmosphere over an extended field of view using a phased laser array. The system projects laser energy onto specific locations of extended objects in various geometries, overcomes atmospheric anisoplanatism and backscatter; estimates phase across the full aperture, and reconstructs the target object in great detail to enable high-resolution aimpoint selection and maintenance. Aimpoint maintenance is performed by sequentially analyzing a passive image and a laser spot in rapid succession, in each subaperture at high signal-to-noise ratio. As a further improvement, backscatter issues from the projected laser beam are eliminated by cycling the laser and/or sequentially lasing on different wavelengths within the laser gain bandwidth.

Laser phase diversity for beam control in phased laser arrays

A system and method are disclosed for information assurance for networked systems. The system and method involve a quantum key distribution (QKD) source, a gimbaling device, a receiver, and a sender. The QKD source is mounted on the gimbaling device, and the QKD source propagates energy into an oversized spot beam. The receiver and the sender are within optical communication of each other. The gimbaling device performs pointing acquisition tracking only as necessary to keep the receiver located within the oversized spot beam. When the receiver is located within the oversized spot beam, the QKD source performs a QKD function. In one or more embodiments, the gimbaling device is mounted on a mobile platform. In some embodiments, the mobile platform is mounted on an unmanned aerial vehicle (UAV). In other embodiments, the mobile platform is mounted on a small ground vehicle.

Information assurance for networked systems

Systems and methods which combine standard image reconstruction and beam-control techniques with tomographic estimation of three-dimensional atmospheric turbulence to enable high-quality anisoplanatic imaging of distant objects at long range through the atmosphere over an extended field-of-view using a large aperture. More specifically, the systems and methods combine the concepts of atmospheric tomography, forward-model image reconstruction and tip, tilt, beam-walk, and focus control techniques to produce image reconstructions of high quality for large objects that move rapidly as viewed by large apertures in weak or strong extended atmospheric turbulence.

Growing community of inventors

Thousand Oaks, CA, United States of America

Paul S Idell