Honeywell International Inc.

Chaya Garg

Vasantha Selvi Paulraj

Mahesh Kumar Sampath

Robert E De Mers

Jitender Kumar Agarwal

Sivakumar Kanagarajan

Hariharan Saptharishi

Roger W Burgin

Gobinathan Baladhandapani

Anil Kumar Songa

Kiran Gopala Krishna

Steven Curtis Crouch

Jeff Lancaster

Sudarshan Parthasarathy

Erik T Nelson

Naveen Venkatesh Prasad Nama

Naveen VenkateshPrasad Nama

Mohan M Thippeswamy

Robert E DeMers

Ramakrishnan Raman

Rahul Pradhan

Nitish Sharma

Ravi Tupakula

Vasantha Paulraj

Sivakumar Kangarajan

Naveen Nama

Systems and methods for indicating communication effectiveness with air traffic control (ATC) are disclosed. The method includes: receiving a transcribed message containing a plurality of words used by an ownship flight crew member in a communication directed to ATC; determining a message intent of the transcribed message from the words used in the communication; identifying a plurality of ideal words that should be used for an ideal message having the same message intent as the transcribed message; comparing the words used in the communication with the words that should have been used in the ideal message; determining based on the comparing whether the words used in the communication conformed to ATC standard phraseology (e.g., ICAO Pilot communication vocabulary); generating an indicator for flight crew that indicates whether the words used in the communication conformed to ATC standard phraseology; and signaling an aircraft display device to display the indicator.

Systems and methods for indicating communication efficiency or compliance with ATC phraseology

Methods and systems are provided for displaying transcriptions of radio communication transcription for an aircraft. The method comprises capturing audio signals of radio communication traffic to and from the aircraft. The captured audio signals are preprocessed to divide the signals into independent spoken utterances. Each spoken utterance is transcribed using a speech recognition decoder that utilizes an air traffic control (ATC) speech recognition model and classification data is extracted from the transcription of each spoken utterance. The transcription of each spoken utterance is logged with reference to the classification data and a textual display of the transcription is provided to a crew member of the aircraft.

System and method for displaying radio communication transcription

Methods and systems are provided for assisting operation of a vehicle using speech recognition. One method involves analyzing a transcription of an audio communication with respect to the vehicle to characterize a nonstandard pattern within the transcription of the audio communication, obtaining a ground truth for the transcription of the audio communication, determining one or more performance metrics associated with the nonstandard pattern within the transcription based on a relationship between the transcription of the audio communication and the ground truth for the transcription, updating a speech recognition vocabulary for the vehicle to include the nonstandard pattern based at least in part on the one or more performance metrics and determining an updated speech recognition model for the vehicle using the updated speech recognition vocabulary and the audio communication.

Adaptive speech recognition methods and systems

A voice recognition system in an aircraft is provided. The voice recognition system includes: a voice recognition controller configured to receive a voice command from a flight crew member voice interface, convert the voice command to an avionics system command, and forward the avionics system command to an avionics system for execution. The voice recognition system further includes an application controller configured to: receive the avionics system command that has been converted from the voice command; determine whether the avionics system command can be performed; cause the avionics system command to be performed when it is determined that the avionics system command can be performed; and when it is determined that the avionics system command cannot be performed, generate a message that provides a reason why the avionics system command cannot be performed and cause the message to be displayed on a display device and/or annunciated on an aural device.

System and method for providing contextual feedback in response to a command

A voice activatable flight deck system including a voice recognition and processing system for receiving and processing input voice commands and determining machine commands for the voice activatable flight deck system. The system generates a voice ribbon specifying voice commanded and suggested values for attributes associated with the voice command.

Methods and systems for using voice commands and a smart scratch pad to tune a radio in a voice activated flight deck

Methods and systems are provided for validation of speech commands from an aircraft pilot. The method comprises receiving a speech command from the aircraft pilot with a voice communication device that is part of a cockpit system. Next, the speech command is decoded into a computer readable format. The decoded speech command is then checked against the present aircraft state as indicated by avionic sensors of the aircraft and against an approved pre-condition that is stored in a pre-condition database. The decoded speech command is validated if the decoded speech command is consistent with the present aircraft state and consistent with the approved pre-condition. An input to the cockpit system is updated to execute the speech command from the aircraft pilot if the decoded speech command is validated.

System and method for smart validation of pre-conditions in executing pilot voice commands

A voice activatable flight deck system including a voice recognition and processing system for receiving and processing input voice commands and determining machine commands for the voice activatable flight deck system. The system provides indications as to whether user interface functional elements are voice command enabled, disabled or whether voice command input is not available. The system provides directional feedback to the voice command depending on whether a pilot in command or second in command issued the voice input.

Method and systems for providing contextual visual and aural feedback and awareness to flight crews using a voice activated flight deck

Systems and methods are provided for playback clearance assistance, the system includes a processing system configured to: in response to receipt of a voice clearance communication comprising a clearance message, decode the clearance message to identify features contained within the clearance message related to a command instruction or clearance data for a flight; determine, at least one applicable clearance message amendment solution for use to amend the clearance message from a set of applicable clearance message amendment solutions wherein the applicable clearance amendment solution is determined based on keywords retrieved from a plurality of databases comprising at least contextual and prior clearance message data; and apply the applicable clearance message amendment solution to append keywords to the clearance message to generate an appended clearance message that reduces ambiguity in the clearance message resulting from at least missing value data, non-standard terminology or incomplete message information.

System and method for assisting pilot through clearance playback

A method for displaying received radio voice messages onboard an aircraft is provided. The method post-processes, by at least one processor onboard the aircraft, a set of speech recognition (SR) hypothetical data to increase accuracy of an associated SR system, by: obtaining, by the at least one processor, secondary source data from a plurality of secondary sources; comparing, by the at least one processor, the set of SR hypothetical data to the secondary source data; and identifying, by the at least one processor, an aircraft tail number using the set of SR hypothetical data and the secondary source data; identifies, by the at least one processor, a subset of the received radio voice messages including the tail number; and presents, via a display device onboard the aircraft, the subset using distinguishing visual characteristics.

Methods and apparatus for post-processing speech recognition results of received radio voice messages onboard an aircraft

An intent managing system and a method for operating the same are provided. The system, for example, may include, but is not limited to a processor communicatively coupled to an input system and a memory. The processor may be configured to receive a voice command, determine how many of a plurality of voice controllable systems utilize the voice command, automatically select one of the plurality of voice controllable systems, generate an indication of the selected one of the plurality of voice controllable systems, receive, from the at least one input system, confirmation of the selected one of the plurality of voice controllable systems, and execute the received voice command at the selected one of the plurality of voice controllable systems when the confirmation is received.

Intent managing system

A verbal taxi clearance system for an aircraft and a method of controlling the same are provided. The system, for example, may include, but is not limited to a communication system, and a processor communicatively coupled to the communication system, the processor configured to receive, from the communication system, first audio data from air traffic control, convert the first audio data from air traffic control into first taxi route data, receive second audio data from a cockpit of the aircraft, convert the second audio data into second taxi route data, compare the first taxi route data to the second taxi route data, output, when the first taxi route data matches the second taxi route data, a taxi route corresponding to the first and second taxi route data, and generate an alert when the first taxi route data does not match the second taxi route data.

Growing community of inventors

Plymouth, MN, United States of America

Chaya Garg