Honeywell International Inc.

Jitender Kumar Agarwal

Satyanarayan Kar

Sanjib Kumar Maji

Sandeep Chakraborty

Vasantha Selvi Paulraj

Mohan M Thippeswamy

Robert E De Mers

Kiran Gopala Krishna

Chaya Garg

Roger W Burgin

Mahesh Kumar Sampath

Naveen Venkatesh Prasad Nama

Ramakrishnan Raman

Sivaprakash Pasupathi

Rahul Pradhan

Nitish Sharma

Sujith Kuttappan

A method of displaying information is provided. The method includes displaying, by a transcription app, a set of traffic operating in airspace of a first category of traffic and second category traffic wherein the first category of traffic includes a set of aircraft that is operating within a defined range to the ownship in comparison to the second category of traffic that includes another set of aircraft that is operating outside the defined range to the ownship; classifying the first category of traffic at the closer distance to the ownship as proximate traffic and the second category of traffic at the further distance to the ownship as non-proximate traffic for enabling at least selection of either the proximate traffic or the non-proximate traffic on the display device for decluttering the display of traffic on the display device.

Method and system to filter and sort clearances in air traffic control (ATC) transcription

Systems and methods are provided for a transcription system with voice activity detection (VAD). The system includes a VAD module to receive incoming audio and generate an audio segment; and a speech decoder with a split predictor to perform, in a first pass, a decode operation to transcribe text from an audio segment into a message; wherein in the first pass, if the message is determined not to contain a split point based on a content-based analysis performed by the split predictor, the speech decoder forwards the message for display and if the message is determined based on the content-based analysis to contain the split point, the speech decoder performs in a second pass, a re-decode operation to transcribe text from the audio segment based on the split point wherein the split point is configured within an audio domain of the audio segment by the split predictor and forward the message for display.

System and method for handling unsplit segments in transcription of air traffic communication (ATC)

Methods and systems are provided for displaying transcriptions of radio communication transcription for an aircraft. The method comprises capturing audio signals of radio communication traffic to and from the aircraft. The captured audio signals are preprocessed to divide the signals into independent spoken utterances. Each spoken utterance is transcribed using a speech recognition decoder that utilizes an air traffic control (ATC) speech recognition model and classification data is extracted from the transcription of each spoken utterance. The transcription of each spoken utterance is logged with reference to the classification data and a textual display of the transcription is provided to a crew member of the aircraft.

System and method for displaying radio communication transcription

Methods and systems are provided for assisting operation of a vehicle using speech recognition. One method involves analyzing a transcription of an audio communication with respect to the vehicle to characterize a nonstandard pattern within the transcription of the audio communication, obtaining a ground truth for the transcription of the audio communication, determining one or more performance metrics associated with the nonstandard pattern within the transcription based on a relationship between the transcription of the audio communication and the ground truth for the transcription, updating a speech recognition vocabulary for the vehicle to include the nonstandard pattern based at least in part on the one or more performance metrics and determining an updated speech recognition model for the vehicle using the updated speech recognition vocabulary and the audio communication.

Adaptive speech recognition methods and systems

Systems and methods are provided for training of an Automatic Speech Recognition (ASR) model during runtime of a transcription system, the system includes a background processor configured to operate with the transcription system to display a speech-to-text sample of an audio segment of a cockpit communication with an identifier which is converted using an ASR model wherein the background processor receives a response by a user during runtime of the transcription system and display of the speech-to-text sample and causes a change to the identifier to either a positive or negative attribute upon a determination of the correctness of a conversion process of the speech-to-text sample using the ASR model by review of a display of the content of the speech-to-text sample; and to train the ASR model based on information associated with the content of the speech-to-text sample in accordance with the response by the user.

System and method for improving air traffic communication (ATC) transcription accuracy by input of pilot run-time edits

Systems and methods are provided for the selection of a speech model for automatic speech recognition during the runtime of a transcription system, the system includes an event detector to determine one of a number of flight events that include flight plan changes and phase transitions based on data received from a set of inputs; an intelligent keyword generator to collate a set of keywords associated with the flight plan information and to generate a wordlist in response to a determination by the event detector of flight plan changes or flight phase transitions; and a processor to determine whether the wordlist is covered by a current speech model implemented in the automatic speech recognition wherein if the wordlist is not covered by the current speech model, then the processor to select a pre-built speech model that covers the wordlist for use as the current speech model in the automatic speech recognition.

System and method for constraining air traffic communication (ATC) transcription in real-time

A system is provided that includes a processor configured to receive an input of a user in response to a display of a text segment generated by a decode operation of an audio segment wherein the processor is configured to if the user determines by viewing a display containing one or more text segments that the one or more text segments include an improper splitting of text segments, perform a merge action in response to a user input to merge the one or more text segments into a single text segment for display; and if the user determines by viewing a display containing the at least one single text segment that the at least one single text segment should be split, perform a split action in response to the user input to split the at least one single text segment into the one or more text segments.

System and method for merging and splitting of messages with user input in air traffic communication (ATC) transcription

A system for extracting speaker information in an ATC transcription and displaying the speaker information on a graphical display unit is provided. The system is configured to: segment a stream of audio received from an ATC and other aircraft into a plurality of chunks; determine, for each chunk, if the speaker is enrolled in an enrolled speaker database; when the speaker is enrolled in the enrolled speaker database, decode the chunk using a speaker-dependent automatic speech recognition (ASR) model and tag the chunk with a permanent name for the speaker; when the speaker is not enrolled in the enrolled speaker database, assign a temporary name for the speaker, tag the chunk with the temporary name, and decode the chunk using a speaker independent speech recognition model; format the decoded chunk as text; and signal the graphical display unit to display the formatted text along with an identity for the speaker.

System and method for extracting and displaying speaker information in an ATC transcription

A transcription system for an aircraft is configured to: generate an ownship call sign list that includes a plurality of potential ownship call signs that may be used in messages from ATC directed to the ownship, categorize a received message as being directed to the ownship when a recovered call sign from the message corresponds to a call sign from the ownship call sign list; and signal an aircraft display device to display a graphical message element that is representative of the received message, includes a textual representation of message content and the recovered call sign from the received message, and that is displayed in a manner that indicates whether the received message has been categorized as being directed to the ownship or traffic aircraft. The transcription system for an aircraft may be configured to re-categorize a previously categorized received ATC message based on flight crew interaction with a GUI.

Systems and methods for presenting messages to flight crew

A method for controlling an interactive display is provided. The method receives a set of voice input data, via a voice input device communicatively coupled to the interactive display; interprets, by at least one processor, the set of voice input data to produce an interpreted result, wherein the at least one processor is communicatively coupled to the voice input device and the interactive display; presents, by the interactive display, a text representation of the interpreted result coupled to a user-controlled cursor; receives, by a user interface, a user input selection of a textual or graphical element presented by the interactive display, wherein the user interface is communicatively coupled to the at least one processor and the interactive display; and performs, by the at least one processor, an operation associated with the interpreted result and the user input selection.

Methods and apparatus for voice-activated control of an interactive display

A method for displaying received radio voice messages onboard an aircraft is provided. The method post-processes, by at least one processor onboard the aircraft, a set of speech recognition (SR) hypothetical data to increase accuracy of an associated SR system, by: obtaining, by the at least one processor, secondary source data from a plurality of secondary sources; comparing, by the at least one processor, the set of SR hypothetical data to the secondary source data; and identifying, by the at least one processor, an aircraft tail number using the set of SR hypothetical data and the secondary source data; identifies, by the at least one processor, a subset of the received radio voice messages including the tail number; and presents, via a display device onboard the aircraft, the subset using distinguishing visual characteristics.

Methods and apparatus for post-processing speech recognition results of received radio voice messages onboard an aircraft

A method for receiving data onboard an aircraft is provided. The method obtains a plurality of aircraft transponder messages associated with a particular landing zone; extracts, from each of the plurality of aircraft transponder messages, aircraft position data associated with landing at least one lead aircraft at the particular landing zone; and determines a landing path for use by the aircraft to land at the particular landing zone, based on the extracted aircraft position data.

Methods and apparatus for obtaining aircraft landing guidance

An avionics system and method is provided that de-clutters an image on a cockpit display system on a host aircraft, thus increasing a pilot's situational awareness. The avionics display system comprises a processor and a display system. The processor is coupled to the display system, a user input device, and a plurality of sources of information layers. When the de-clutter process is enabled, a filter parameter is applied to a selected information layer, and a graphic display of the filtered information layer is provided. The adjustable filter parameter can be applied to any of the information layers displayed on the cockpit display system.

System and method for decluttering an image on a cockpit display system

An aircraft system for an own-ship aircraft includes an ADS-B unit configured to receive ADS-B messages with flight information from other aircraft over a plurality of time periods, the other aircraft including a first aircraft. The system further includes a database configured to store at least a portion of the flight information associated with the other aircraft over the plurality of time periods. The system further includes a processing unit configured to compare the flight information for a current time period to the flight information for a previous time period to identify missing flight information from the current time period relative to the previous time period, the missing flight information including the flight information associated with the first aircraft, and initiate an annunciation to an operator of the own-ship aircraft based on the missing flight information associated with the first aircraft.

Aircraft systems and methods to monitor proximate traffic

A system and method capable of responding to an audible traffic alert by visually depicting the identified neighboring aircraft traffic on the onboard display is presented. The system and method employ speech recognition in order to minimize the visual and manual cognitive workload associated with responding to a traffic alert. The system and method maximize the pilot's hands-on control of the host aircraft.

Growing community of inventors

Uttar Pradesh, India

Jitender Kumar Agarwal