Honeywell International Inc.

The Boeing Company

Kiran Gopala Krishna

Hariharan Saptharishi

Vinoda Ramaiah

Robert E De Mers

Gobinathan Baladhandapani

Jitender Kumar Agarwal

Vasantha Selvi Paulraj

Sivakumar Kanagarajan

Dave Pepitone

Narayanan Srinivasan

Satyanarayan Kar

Chaya Garg

Erin Elizabeth Alves

Mohammed Ibrahim Mohideen

Roger W Burgin

William Ray Hancock

Saravanakumar Gurusamy

Seema Chopra

Visvanathan Thanigai Nathan

Mahesh Kumar Sampath

Muthusankar Subramaniyan

Vishnu Vardhan Reddy Annapureddy

Sivaprakash Pasupathi

Shashidhara Ganganna

Bincicil Mathew

Vamsi Agasthyaraju

Dan Lopez

Rajiv Veeranna

Methods and systems are provided for autonomously enabling remote operation of a vehicle such as an aircraft in response to detecting an event that may impact manual operation of the vehicle. One method autonomously detects an event with respect to manual operation of the vehicle based at least in part on output from one or more systems onboard the vehicle, identifies a hands-free functionality of a vehicle system to be activated based at least in part on a characteristic of the event, and autonomously initiates activation of the hands-free functionality of the vehicle system. A command for operating the vehicle is received from an external system via an onboard communications system and provided to the vehicle system for further implementation or execution using the hands-free functionality.

Methods and systems for remote operation of vehicles using hands-free functionality

An interface system for flight deck communications includes a chatbot configured to perform a conversation with a pilot. The conversation includes speech communications, visual communications using a display, or both. The interface system also includes a dynamic conversational graph generator. The dynamic conversational graph generator is configured to perform a set of functions including determining a flight operational procedure from the conversation with the pilot. The set of functions also include providing information associated with the flight operational procedure to the chatbot for communicating to the pilot. The set of functions also include responding to any requests received from the pilot by the chatbot during the conversation with the pilot.

Interface system for flight deck communications

Methods and systems for speech recognition in an aircraft are disclosed. Methods and systems include executing an air traffic control transcription application using first acoustic and language models and executing a command and control speech recognition application using second acoustic and language models. Flight context data is processed to identify additional words not included in training of the second acoustic and language model but included in training of the first acoustic and language models. Acoustic and language model parameters are extracted corresponding to the additional words from the first acoustic and language models. The extracted acoustic and language model parameters are added to the second acoustic and language models. An aircraft control command is generated that encapsulates at least one of the additional words using the command and control speech recognition application.

Aircraft speech recognition systems and methods

Systems and methods are provided for playback clearance assistance, the system includes a processing system configured to: in response to receipt of a voice clearance communication comprising a clearance message, decode the clearance message to identify features contained within the clearance message related to a command instruction or clearance data for a flight; determine, at least one applicable clearance message amendment solution for use to amend the clearance message from a set of applicable clearance message amendment solutions wherein the applicable clearance amendment solution is determined based on keywords retrieved from a plurality of databases comprising at least contextual and prior clearance message data; and apply the applicable clearance message amendment solution to append keywords to the clearance message to generate an appended clearance message that reduces ambiguity in the clearance message resulting from at least missing value data, non-standard terminology or incomplete message information.

System and method for assisting pilot through clearance playback

Vehicle systems and methods are provided for capturing audio during operation for subsequent presentation and analysis. One method involves obtaining a plurality of audio segments via an audio input device onboard an aircraft, classifying each audio segment of the plurality of audio segments into one or more of a plurality of topic categories based at least in part on the content of the respective audio segment, and providing a graphical user interface (GUI) display depicting the plurality of audio segments in a time-ordered sequence. The GUI display includes GUI elements for selectively removing subsets of audio segments classified into particular topic categories from the time-ordered sequence.

Aircraft systems and methods for retrospective audio analysis

A method and system for time-based viewing to coordinate airport collaborative decision making (A-CDM) events between a pilot and ground personnel on a cockpit display of an aircraft of generating a time scale with a list of A-CDM events of the aircraft during inbound, turnaround and outbound flight operations to an airport based sensor data contributed by aircraft systems and data of A-CDM event related to airport operations to generate a current time moving window in the time scale for identifying A-CDM events; generating a graphic user interface using the sensor data for positioning the current time moving window on the time scale; and collaboratively communicating with ground personnel decisions based on an aircraft state and a current A-CDM event identified by the positioning of the current time moving window in the time scale to expedite completion of a particular A-CDM event.

Method and system to improve the situational awareness of all aerodrome ground operations including all turnaround airport collaborative decision making (A-CDM) milestones in the cockpit

Control station audio and data recording systems are provided. The audio recording system comprises an audio packetizer processing unit in a control station and in operative communication with audio sources. The packetizer processing unit generates audio packet information for vehicles in communication with the control station. An audio storage unit communicates with the packetizer processing unit. The audio storage unit stores audio packet information, and provides audio indexing and metadata. An audio playback unit provides access to the stored audio packet information. The data recording system comprises a data processing unit located a the control station. The data processing unit communicates with onboard vehicle data recorders and with other data sources. The data processing unit generates data packet information for the vehicles. A data storage unit communicates with the data processing unit and stores the data packet information. A data playback unit provides access to the stored data packet information.

Control station audio and data recording systems for vehicles

In some examples, a method includes receiving, by a computing device, from a remote sensor, a low-resolution version of data and receiving, by the computing device, user inputs for annotating the low-resolution version of the data. In some examples, the method also includes determining, by the computing device, based on the user inputs, one or more annotations to the low-resolution version of the data. In some examples, the method further includes receiving, by the computing device, from the remote sensor, a high-resolution version of the data and automatically applying, by the computing device, the one or more annotations to the high-resolution version of the data.

Applying features of low-resolution data to corresponding high-resolution data

A method for controlling an interactive display is provided. The method receives a set of voice input data, via a voice input device communicatively coupled to the interactive display; interprets, by at least one processor, the set of voice input data to produce an interpreted result, wherein the at least one processor is communicatively coupled to the voice input device and the interactive display; presents, by the interactive display, a text representation of the interpreted result coupled to a user-controlled cursor; receives, by a user interface, a user input selection of a textual or graphical element presented by the interactive display, wherein the user interface is communicatively coupled to the at least one processor and the interactive display; and performs, by the at least one processor, an operation associated with the interpreted result and the user input selection.

Methods and apparatus for voice-activated control of an interactive display

A method for displaying received radio voice messages onboard an aircraft is provided. The method post-processes, by at least one processor onboard the aircraft, a set of speech recognition (SR) hypothetical data to increase accuracy of an associated SR system, by: obtaining, by the at least one processor, secondary source data from a plurality of secondary sources; comparing, by the at least one processor, the set of SR hypothetical data to the secondary source data; and identifying, by the at least one processor, an aircraft tail number using the set of SR hypothetical data and the secondary source data; identifies, by the at least one processor, a subset of the received radio voice messages including the tail number; and presents, via a display device onboard the aircraft, the subset using distinguishing visual characteristics.

Methods and apparatus for post-processing speech recognition results of received radio voice messages onboard an aircraft

Integrated controller-pilot datalink communication (CPDLC) systems and methods for operating the same are disclosed. In one implementation, an integrated CPDLC system includes a plurality of CPDLC-enabled avionics devices and a CPDLC context manager coupled with each of the plurality of CPDLC-enabled avionics devices. The CPDLC system further includes a shared CPDLC context memory coupled with the CPDLC context manager and a CPDLC message in/out buffer coupled with the CPDLC context manager.

Integrated controller-pilot datalink communication systems and methods for operating the same

A system and method for providing integrated time-based notification and aircraft status data on a display is provided. The system and method receives aircraft status data, pilot input data, data link notification data and aircraft notification data. The system and method generates and displays a timescale region divided into equal intervals from a predetermined origin with an icon graphically representative of a position of the aircraft overlaid with an icon graphically representative of notification data. The system and method continuously updates the temporal data as the aircraft flies, and responds to user requests to pan forward in time, pan backward in time and adjust the zoom on the timescale.

System and method for integrated time based notification for improved situational awareness

A system and method display a hazard free area around an aircraft that is modified to alert a pilot if a threshold distance between a detected object and the aircraft is reached. The modification may include, for example, altering the size of the hazard free area and its color. Additional information that may be displayed includes distance to the object, width of the hazard free area, stopping distance of the aircraft, and a route to avoid the object.

System and method for highlighting an area encompassing an aircraft that is free of hazards

A system and method for recognizing speech on board an aircraft that compensates for different regional dialects over an area comprised of at least first and second distinct geographical regions, comprises analyzing speech in the first distinct geographical region using speech data characteristics representative of speech in the first distinct geographical region, detecting a change in position from the first distinct geographical region to the second geographical region, and analyzing speech in the second distinct geographical region using speech data characteristics representative of speech in the second distinct geographical region upon detecting that the aircraft has transitioned from the first distinct geographical region to the second distinct geographical region.

System and method for correcting accent induced speech in an aircraft cockpit utilizing a dynamic speech database

A display system for an aircraft is provided. The system includes a processing unit configured to receive weather information associated with a flight path of a flight plan and to generate display commands based on the weather information. The flight plan includes a first waypoint associated with a first altitude. The system further includes a display device coupled with the processing unit and configured to receive the display commands and to display symbology representing the weather information. The weather information includes first weather information for the first altitude and second weather information at a second altitude, different from the first altitude.

Growing community of inventors

Karnataka, India

Kiran Gopala Krishna