Rockwell Collins, Inc.

Ahmad F Osman

Peggy Wu

A computer-implemented method is described. The method is be implemented by processors of an aircraft system. The method includes receiving images of an eye and a lighting configuration associated with a cockpit of an aircraft. The method further includes detecting a position of the eye within each of the images. The method further includes compensating for a pupillary light response of the eye based on the position of the eye within the image and the lighting configuration. By compensating for the pupillary light response, a fatigue level of the operator is estimated with reduced noise.

Cockpit display ambient lighting information for improving gaze estimation

A system and method for continuous real-time assessment of the situational awareness of an aircraft operator incorporates gaze sensors to determine the current gaze target (or sequence of gaze targets) of the operator, e.g., which interfaces the operator is looking at. The system receives operational context from aircraft systems indicative of current events and conditions both internal and external to the aircraft (e.g., operational status, mission or flight plan objectives, weather conditions). Based on the determined gaze targets and coterminous operational context, the system evaluates the situational awareness of the operator relative to the operational context, e.g., perceptive of the operational context; comprehending the operational context and its implications, and projecting the operator's perception and comprehension into responsive action and second-order ramifications according to task models indicative of expected behavior.

System and method for assessing operator situational awareness via context-aware gaze detection

A system and method for inferring operator intent by detecting operator focus incorporates cameras positioned within a cockpit or control space of a vehicle and oriented at an operator of the vehicle. The cameras capture images of the operator in a control seat; the images are analyzed (either individually or sequentially) to determine a gaze and/or body pose of the operator (including, e.g., a position and orientation of the torso and limbs). By comparing the determined gaze and/or body pose to the positions and orientations of potential focus targets within the control space (e.g., windows, display units, and/or control panels that the operator may engage with visually and/or physically), the system predicts the most likely future focus target or targets: what the operator is most likely to visually and/or physically engage with next. Operator intent may be further analyzed to identify potentially abnormal or anomalous behavior.

Growing community of inventors

Wethersfield, CT, United States of America

Ahmad F Osman