Honeywell International Inc.

Michael C Dorneich

Stephen D Whitlow

Patricia May Ververs

William H Rogers

Santosh Mathan

Chris Hamblin

Claudia Keinrath

Jeffrey Mathew Rye

James C Carciofini

Thea Lynn Feyereisen

Aaron James Gannon

Robert E De Mers

Donald C Kauffman

Stephen G McCauley

Karen Feigh

Janet Creaser

Michael D Good

An augmented tutoring system is provided that includes a simulation device, at least one sensor and a controller. The simulation device is adapted to provide a simulation that has an objective to accomplish by a student, wherein to achieve the objective a plurality of tasks must be correctly completed. The at least one sensor is adapted to monitor a cognitive state of the student while engaged with the simulation. The controller is adapted to process cognitive state information from the at least one sensor and to process student progress information relating to the completion of each of the tasks. The controller is further adapted to provide feedback to the student based at least in part on the processed cognitive state information and the processed task completion information.

Augmented tutoring

A system and method are provided for prioritizing incoming datalink messages. When a datalink message is received in an aircraft, it is parsed into individual information elements. The relevance of the received datalink message is then assessed from the individual information elements. The received datalink message is then categorized into one of a plurality of playback priority categories, based on the assessed relevance of the received datalink message.

Datalink message prioritization system and method

A system for providing feedback regarding the division of automated and operator tasks is provided. The system includes a display device and a processor. The processor is configured to at least selectively supply image rendering display commands to the display device that cause the display device to simultaneously render an operator pane, an automation pane, and a shared pane. The operator pane displays one or more tasks that have been allocated for execution by a human operator, the automation pane displays one or more tasks that have been allocated for execution by automation, and the shared pane displays one or more tasks that have been allocated for execution by both automation and a human operator.

User interface device for adaptive systems

A system and method are provided for transferring datalink-based information into an aircraft flight management system. When a datalink message is received in an aircraft, it is parsed into individual information elements. The operational impact of the received datalink message on the aircraft is determined from the individual information elements. A method of supplying pilot feedback regarding the received datalink message is determined from the determined operational impact. The pilot feedback regarding the received datalink message is supplied using the determined method. At least selected portions of the individual information elements are selectively transferred into the aircraft flight management system (FMS).

Mixed-intiative transfer of datalink-based information

A system and method for providing more than two levels of classification distinction of a user state are provided. The first and second general states of a user are sensed. The first general state is classified as either a first state or a second state, and the second general state is classified as either a third state or a fourth state. The user state of the user is then classified as one of at least three different classification states.

Multiple two-state classifier output fusion system and method

A system and method for assisting flight crew recovery in the aftermath of an unexpected event is provided. A processor is used to detect that an unexpected event has occurred in an aircraft and, in response to detecting that the unexpected event has occurred, state data are stored in memory. The processor is also used to detect that the unexpected event has been resolved and, in response to detecting that the unexpected event has been resolved, the processor retrieves the state data from the memory, generates an aftermath plan that includes prompts to guide the flight crew to complete the aftermath plan, and continuously updates the aftermath plan until the aftermath plan is completed.

Situation aftermath management system and method

A method is provided for semi-automatic operation of a portable control device for a remote-controlled, unmanned vehicle. The method includes the steps of monitoring parameters of an operational environment of the portable control device, switching from a manual operation mode to a semi-automatic operation mode in response to occurrence of predetermined criteria within the operational environment, and presenting a semi-automatic operation graphical user interface to a user of the portable control device. The semi-automatic operation graphical user interface includes a reduced set of user interfaces for the semi-automatic operation mode presented by the portable control device.

Adaptive user interface for semi-automatic operation

A system and method are provided for facilitating workload management. The system processes first sensor data to estimate the current cognitive state of a first person, and processes second sensor data to estimate the current cognitive state of a second person. Information representative of the estimates of the current cognitive states of the first person and the second person is simultaneously rendered on a display device.

Workload management system and method

A display system and method for providing a display. A display system includes a computer processor, the computer processor being configured to receive information from a plurality of sensors. The computer processor is further configured to detect an abnormal situation, based on information received from the plurality of sensors. The display system further includes a database including abnormal situation response procedures in operable communication with the processor, wherein the database is configured to provide the processor with the abnormal situation response procedures upon the detection of an abnormal situation. The display system further includes a display device in operable communication with the processor, wherein the display device is configured to display information from the sensors regarding the abnormal situation and the abnormal situation response procedures.

Display system and method for generating a display

Integrated surveillance systems and methods for processing multiple sensor inputs and determining a best route for avoiding multiple hazards. An example method performed on a first aircraft includes generating a plurality of routes for avoiding a previously determined alert from a first advisory system. Then, probability of success information is generated at other advisory systems for each of the plurality of routes. The best route of the plurality of routes is determined based on the generated probabilities and output to the flight crew or other aircraft. The probability of success information includes a previously defined uncertainty value. The uncertainty value corresponds to quality of data provided to or provided by the respective advisory system.

Cognitive aircraft hazard advisory system (CAHAS)

A method and system are provided that prioritize the output of an image triage that is based on rapid serial visual presentation. User responses and estimates of the effectiveness with which each image is likely to have been processed by a user are employed for post triage image prioritization of potential targets. Images associated with a user response, processed during optimal user states, are assigned the highest priority for post triage examination, as targets are likely. Images without a user response that are processed during optimal user states are assigned the lowest priority, as these are unlikely to contain targets. Images with a user response that are processed during suboptimal states are assigned a medium priority, as these are likely to contain a high number of false positives. Images without a user response, processed during suboptimal user states are flagged for reprocessing as these may contain targets that the user may not have detected.

Rapid serial visual presentation triage prioritization based on user state assessment

A system and method of efficiently and effectively triaging an image that may include one or more target entities are provided. A target entity to be searched for in the image is specified. The image, or at least a selected portion of the image, is then divided into a plurality of individual image chips each having a chip size based on the specified target entity. Each image chip is then successively displayed for a presentation time period.

Target specific image scaling for effective rapid serial visual presentation

A system and method of efficiently and effectively triaging an image that may include one or more target entities. The image is divided into a plurality of individual image chips, and each image chip is successively displayed to a user for a presentation time period. Data are collected from the user at least while each image chip is being displayed. For each image chip, a probability that the image chip at least includes a target entity is assigned, based at least in part on the collected data. The image is then displayed with the assigned probabilities overlaid thereon.

Neurophysiologically driven high speed image triage system and method

A communications system is provided that includes a communications scheduler adapted to receive messages from a plurality of message sources and sensors. The messages comprise human and generated messages. The sensors comprise situational, neurophysiological and physiological sensors. The cognitive state profile processing unit receives sensor data and produces a current cognitive state profile for the user. The communications scheduler includes a context manager that receives outputs from the plurality of sensors, monitors a current user's tasks, and retains information about the user's environment, a message characterization unit that characterizes the messages using the attributes of the message, outputs from the sensors, and the user's specific baseline profile data and a presentation unit that receives the characterized messages, the cognitive state profile, and context information and queues the characterized messages into a prioritized message list and presents the message list to the user via the display unit.

Communications system based on real-time neurophysiological characterization

An electroencephalograph system and method for controlling the stability of an adaptive filter during high noise spikes in ocular sensor channels. The method comprises receiving a signal from at least one sensor and determining when an adaptive filter algorithm is subject to becoming unstable based on a signal from the at least one sensor. Operation of the adaptive filter algorithm is suspended while the algorithm is subject to becoming unstable.

Growing community of inventors

Saint Paul, MN, United States of America

Michael C Dorneich