The Boeing Company

Nathan C Perry

Jesse Lee Kresevic

Johann F Thaheld

Matthew James Gilchrist

John Towers

Christopher P Galea

A method is described. The method comprises obtaining a recording of one or more physical interactions performed in relation to one or more physical components, in a simulation environment, playing back the recording such that the one or more physical interactions are represented in the simulation environment, and in the simulation environment, detecting a user interaction with one or more physical components of the simulation environment. The method further comprises determining whether the user interaction is congruent with at least one corresponding physical interaction of the one or more physical interactions in the recording, and in response to such congruence, continuing playback of the recording in the simulation environment.

Recorded physical interaction playback

A system and method that detect situation awareness failures in operators of remotely operated vehicles and consequently alert the operators and/or activate a fail-safe mode in the vehicles to reduce potential for an accident. Real-time values of indicators displayed on a control station are periodically stored in a database and compared to inspected values of each indicator stored when the operator last viewed each indicator to determine if there is a difference representing an operator's level of awareness. An eye-tracking system is used to monitor the operator's point-of-gaze and awareness of each indicator. If there is a difference beyond an acceptable level of deviation between the real-time value and the inspected value, the system alerts the operator and/or commands the remotely operated vehicle to commence a fail-safe operation.

Method and system for detecting and remedying situation awareness failures in operators of remotely operated vehicles

An aviation performance evaluation methodology that can be implemented in various ways depending on the applications of interest. Baseline standards for expected performance are stored in one or more databases. One database may contain performance parameters and another database may contain baseline standards such as expert gaze data. Real-time actual performance data is acquired using an eye tracker system comprising at least one video camera, at least one infrared light source, and a computer system which receives image data from the video camera(s). More specifically, the actual and expected performance data are input to a computer system that is programmed to analyze the actual performance based on a comparison of the actual and expected performance data. Based on the results of the comparative analysis, context-adjusted inferences can be made regarding performance, adopted strategies, gaze scan quality, alertness or distraction, situational awareness, and workload.

Growing community of inventors

Brisbane, Australia

Nathan C Perry