The Boeing Company

Jesse Lee Kresevic

Nathan C Perry

Matthew James Gilchrist

Christopher P Galea

A method is described. The method comprises obtaining a recording of one or more physical interactions performed in relation to one or more physical components, in a simulation environment, playing back the recording such that the one or more physical interactions are represented in the simulation environment, and in the simulation environment, detecting a user interaction with one or more physical components of the simulation environment. The method further comprises determining whether the user interaction is congruent with at least one corresponding physical interaction of the one or more physical interactions in the recording, and in response to such congruence, continuing playback of the recording in the simulation environment.

Recorded physical interaction playback

A system and method that detect situation awareness failures in operators of remotely operated vehicles and consequently alert the operators and/or activate a fail-safe mode in the vehicles to reduce potential for an accident. Real-time values of indicators displayed on a control station are periodically stored in a database and compared to inspected values of each indicator stored when the operator last viewed each indicator to determine if there is a difference representing an operator's level of awareness. An eye-tracking system is used to monitor the operator's point-of-gaze and awareness of each indicator. If there is a difference beyond an acceptable level of deviation between the real-time value and the inspected value, the system alerts the operator and/or commands the remotely operated vehicle to commence a fail-safe operation.

Growing community of inventors

Queensland, Australia

Jesse Lee Kresevic