Honeywell International Inc.

Mahesh Kumar Sampath

Vasantha Selvi Paulraj

Gobinathan Baladhandapani

Chaya Garg

Hariharan Saptharishi

Sivakumar Kanagarajan

Anil Kumar Songa

Jitender Kumar Agarwal

Mohan M Thippeswamy

Robert E De Mers

Roger W Burgin

Kiran Gopala Krishna

Naveen Venkatesh Prasad Nama

Ramakrishnan Raman

Rahul Pradhan

Karthic V

Sivaprakash Pasupathi

Nitish Sharma

Ravi Tupakula

Systems, methods, and non-transitory computer readable media for identifying a cockpit alert context during an aircraft mission are provided. The system includes a controller configured to: store message content in a clearance look-up table for one or more clearance messages received from air traffic control (ATC) during the aircraft mission that contain cockpit data about which an avionic system in an aircraft may later sense and generate a cockpit system alert for display on a cockpit display device; monitor a plurality of avionic systems in the aircraft for a cockpit system alert; retrieve an ATC clearance message from the clearance look-up table that corresponds to a detected cockpit system alert when a cockpit system alert is detected; and signal an aircraft display device to display the ATC clearance message in a visually distinguishable manner that indicates that the displayed ATC clearance message relates to a detected cockpit system alert.

Systems and methods for identifying context for cockpit alerts

Methods and systems are provided for assisting operation of a vehicle using speech recognition and transcription to provide a conversation log graphical user interface (GUI) display. One method involves analyzing a transcription of an audio communication to identify a discrepancy with respect to an expected response to the communication by an operator of the vehicle, generating, on the conversation log GUI display, a selectable GUI element associated with the discrepancy in association with the graphical representation of the transcription of the audio communication, and in response to user selection of the selectable GUI element, providing, on the conversation log GUI display, a graphical representation of information relating to the discrepancy to facilitate challenging the veracity of the transcribed audio communication.

Transcription systems and methods for challenging clearances

Methods and systems are provided for displaying transcriptions of radio communication transcription for an aircraft. The method comprises capturing audio signals of radio communication traffic to and from the aircraft. The captured audio signals are preprocessed to divide the signals into independent spoken utterances. Each spoken utterance is transcribed using a speech recognition decoder that utilizes an air traffic control (ATC) speech recognition model and classification data is extracted from the transcription of each spoken utterance. The transcription of each spoken utterance is logged with reference to the classification data and a textual display of the transcription is provided to a crew member of the aircraft.

System and method for displaying radio communication transcription

Methods and systems are provided for assisting operation of a vehicle using speech recognition. One method involves analyzing a transcription of an audio communication with respect to the vehicle to characterize a nonstandard pattern within the transcription of the audio communication, obtaining a ground truth for the transcription of the audio communication, determining one or more performance metrics associated with the nonstandard pattern within the transcription based on a relationship between the transcription of the audio communication and the ground truth for the transcription, updating a speech recognition vocabulary for the vehicle to include the nonstandard pattern based at least in part on the one or more performance metrics and determining an updated speech recognition model for the vehicle using the updated speech recognition vocabulary and the audio communication.

Adaptive speech recognition methods and systems

A voice recognition system in an aircraft is provided. The voice recognition system includes: a voice recognition controller configured to receive a voice command from a flight crew member voice interface, convert the voice command to an avionics system command, and forward the avionics system command to an avionics system for execution. The voice recognition system further includes an application controller configured to: receive the avionics system command that has been converted from the voice command; determine whether the avionics system command can be performed; cause the avionics system command to be performed when it is determined that the avionics system command can be performed; and when it is determined that the avionics system command cannot be performed, generate a message that provides a reason why the avionics system command cannot be performed and cause the message to be displayed on a display device and/or annunciated on an aural device.

System and method for providing contextual feedback in response to a command

Methods and systems are provided for assisting operation of a vehicle using speech recognition and transcription using text-to-speech for transcription playback with variable emphasis. One method involves analyzing a transcription of an audio communication with respect to the vehicle to identify an operational term pertaining to a current operational context of the vehicle within the transcription, creating an indicator identifying the operational term within the transcription for emphasis when the operational term pertains to the current operational context of the vehicle, identifying a user-configured playback rate; and generating an audio reproduction of the transcription of the audio communication in accordance with the user-configured playback rate, wherein the operational term is selectively emphasized within the audio reproduction based on the indicator.

Methods and systems for transcription playback with variable emphasis

Methods and systems are provided for validation of speech commands from an aircraft pilot. The method comprises receiving a speech command from the aircraft pilot with a voice communication device that is part of a cockpit system. Next, the speech command is decoded into a computer readable format. The decoded speech command is then checked against the present aircraft state as indicated by avionic sensors of the aircraft and against an approved pre-condition that is stored in a pre-condition database. The decoded speech command is validated if the decoded speech command is consistent with the present aircraft state and consistent with the approved pre-condition. An input to the cockpit system is updated to execute the speech command from the aircraft pilot if the decoded speech command is validated.

System and method for smart validation of pre-conditions in executing pilot voice commands

Systems and methods to identify a query parameter in an incoming flight voice or data communication to respond to a request. A processing system configured to: in response to receipt of a clearance message, decode the clearance message to determine whether the clearance message contains a command instruction or clearance data for a flight, and to present the command instruction to a pilot as notice to execute the command instruction or if available, obtain at least one query parameter from the clearance data to configure in a query operation to present in response to a pilot question about the command instruction. In response to receipt of the voice or data communication, determine further an intent within the voice or data communication of a question or instruction voiced by applying an acoustic model for tagging identified parts about the question or instruction voiced with query parameters in response to the pilot.

Methods and systems for querying for parameter retrieval

Systems and methods are provided for playback clearance assistance, the system includes a processing system configured to: in response to receipt of a voice clearance communication comprising a clearance message, decode the clearance message to identify features contained within the clearance message related to a command instruction or clearance data for a flight; determine, at least one applicable clearance message amendment solution for use to amend the clearance message from a set of applicable clearance message amendment solutions wherein the applicable clearance amendment solution is determined based on keywords retrieved from a plurality of databases comprising at least contextual and prior clearance message data; and apply the applicable clearance message amendment solution to append keywords to the clearance message to generate an appended clearance message that reduces ambiguity in the clearance message resulting from at least missing value data, non-standard terminology or incomplete message information.

System and method for assisting pilot through clearance playback

Systems and methods are provided for entering data into a data entry system. The data entry system includes a user-control device coupled to a display configured to display data field entry locations. The system includes a receiving module for receiving input data. The system includes a parsing module connected to the receiving module for parsing the input data and identifying constituent data elements in the input data. The system also includes a contextual tagging module connected to the parsing module and configured to determine associations between the constituent data elements and the multiple data field entry locations. The system also includes a processor configured to preview the constituent data element on the display when a data field entry location associated with the constituent data element is selected and enter the preview into the data field entry location when the preview is confirmed using the user-control device.

Growing community of inventors

Madurai, India

Mahesh Kumar Sampath