Hrl Laboratories, LLC

The Boeing Company

Other

Charles E Martin

Tsai-Ching Lu

Heiko Hoffmann

Soheil Kolouri

Alice A Murphy

Steve C Slaughter

Peter Petre

Shankar R Rao

Christopher R Wezdenko

Kang-Yu Ni

Praveen K Pilly

Nigel D Stepp

Dmitriy V Korchev

Derek Samuel Fok

David W Payton

Gary Alan Ray

Michael D Howard

Matthew E Phillips

Matthias Ziegler

Bryan H Fong

Nicholas A Ketz

Alex N Waagen

Karl Paul Dockendorf

Stephen C Slaughter

George Spector

Yuri Owechko

Kyungnam Kim

Edward S Martin

Kevin R Martin

Vincent De Sapio

Aruna Jammalamadaka

Jaehoon Choe

Kirby Joe Keller

Samuel D Johnson

Mohammad Rostami

Wei L Yi

Iman Mohammadrezazadeh

Alexander Norman Waagen

Douglas Peter Knapp

Sanaz Adl

Carl J Martin

Richard J Patrick

Brian L Burns

Dean C Mumme

Phillip E Pope

Described is a Neuromorphic Adaptive Core (NeurACore) cognitive signal processor (CSP). The NeurACore CSP includes a NeurACore local learning layer block that is operable for receiving as an input a mixture of in-phase and quadrature (I/Q) signals and mapping the I/Q signals onto a neural network to determine complex-valued output weights of neural states of the neural network. A global learning layer is included that is operable for adapting the complex-valued output weights to predict a most likely next value of the input I/Q signal. Further, a neural combiner is included that operable for combining a set of delayed neural state vectors with weights of the global learning layer to compute an output signal, the output signal being separate in-phase and quadrature signals.

Complex neuromorphic adaptive core (neuracore) and physics enhanced neuromorphic adaptive controller

Described is a system and method for robotic perception and action. The system includes a mobile autonomous platform programmed to receive a visual input related to an environment and perform a movement sequence that affects the environment based on the visual input. A neural network is in communication with the mobile autonomous platform. The neural network includes a vision autoencoder trained, based on movements of the mobile autonomous platform, to encode visual features of an object in the visual input onto a visual latent space. In addition, the neural network includes an action autoencoder trained, based on movements of the mobile autonomous platform, to encode action features of the movement sequence onto an action latent space. The neural network also includes a mapping layer between the vision autoencoder and the action autoencoder. The mapping layer decodes the visual inputs into an action output of the mobile autonomous platform.

Automatic learning of relevant actions in mobile robots

A method, apparatus, system, and computer program product for managing a platform. Sensor information for a platform health of the platform is received from a sensor system for the platform. The sensor information for the platform health of the platform is sent by a computer system into a machine learning model trained using historical sensor information indicating a historical platform health and historical context information corresponding to the historical sensor information in which the historical context information is for a set of operating conditions. A remaining useful life of a component in the platform is received by the computer system from the machine learning model.

Aircraft maintenance of line replaceable units

Described is a system for optimizing controllers for micro-air vehicles. The system identifies binary rules that lead to a desired behavior of a micro-air vehicle. The binary rules are identified by sampling rule-sets from a probability distribution over a search space. A fitness value of each rule-set for the desired behavior is determined, and top-performing rule-sets are selected. The top-performing rule-sets are used to update the probability distribution over the search space until a convergence criterion is met, resulting in a fittest rule-set. A control signal based on the identified binary rules is transmitted to one or more actuators of the micro-air vehicle.

System for evolving controllers for micro-air vehicles

Methods and systems are provided for inferred information propagation for aircraft prognostics. The method includes receiving, by a processor, an original time-series of data points for a component as an input; preprocessing the input to divide the original time-series of data into subsets of data by applying a time-window over the original time-series of data points; and computing, by the processor, a Mutual Information (MI) value for each pair of variables within each subset of data. The method also includes constructing, by the processor, a sequence of relationship graphs using the computed MI values; clustering, by the processor, each relationship graph; and analyzing, by the processor, the time-ordered sequence of clustered relationship graphs to identify features in the component.

Methods and systems for inferred information propagation for aircraft prognostics

Described is a system for automatically identifying chemical properties of a molecule. A chemical representation of a molecular structure is converted into atomic features and an adjacency matrix. The atomic features and the adjacency matrix are processed with a neural network, resulting in neural activations corresponding to each atom in the molecular structure. The system determines a probability for each atom quantifying its relevance for a given chemical characteristic. The probabilities are displayed as a graphical representation on the molecular structure, and groups of atoms are identified for the given chemical characteristic from the graphical representation. The identified groups of atoms for the given chemical characteristic are stored in a database, and a new molecule having the given chemical characteristic is designed based on the stored identified groups of atoms.

System and method for discovering chemically active compounds of a molecule

Described is a system for detecting adversarial activities. During operation, the system generates a multi-layer temporal graph tensor (MTGT) representation based on an input tag stream of activities. The MTGT representation is decomposed to identify normal activities and abnormal activities, with the abnormal activities being designated as adversarial activities. A device can then be controlled based on the designation of the adversarial activities.

System and method for detecting adversarial activities using a compact graph representation

An apparatus for detecting a fault state of an aircraft is provided. The apparatus accesses a training set of flight data for the aircraft. The training set includes observations of the flight data, each observation of the flight data includes measurements of properties selected and transformed into a set of features. The apparatus builds a generative adversarial network including a generative model and a discriminative model using the training set and the set of features, and builds an anomaly detection model to predict the fault state of the aircraft. The anomaly detection model is trained using the training set of flight data, simulated flight data generated by the generative model, and a subset of features from the set of features. The apparatus deploys the anomaly detection model to predict the fault state of the aircraft using additional observations of the flight data.

Detecting fault states of an aircraft

A method includes obtaining sensor data captured by a sensor of an aircraft during a power up event. The sensor data includes multiple parameter values, each corresponding to a sample period. The method further includes determining a set of delta values, each indicating a difference between parameter values for consecutive sample periods of the sensor data. The method further includes determining a set of quantized delta values by assigning the delta values to quantization bins based on magnitudes of the delta values. The method further includes determining a normalized count of delta values for each quantization bin. The method further includes comparing the normalized counts of delta values to anomaly detection thresholds. The method further includes generating, based on the comparisons, output indicating whether the sensor data is indicative of an operational anomaly.

Anomaly prediction and detection for aircraft equipment

A memory circuit configured to perform multiply-accumulate (MAC) operations for performance of an artificial neural network includes a series of synapse cells arranged in a cross-bar array. Each cell includes a memory transistor connected in series with a memristor. The memory circuit also includes input lines connected to the source terminal of the memory transistor in each cell, output lines connected to an output terminal of the memristor in each cell, and programming lines coupled to a gate terminal of the memory transistor in each cell. The memristor of each cell is configured to store a conductance value representative of a synaptic weight of a synapse connected to a neuron in the artificial neural network, and the memory transistor of each cell is configured to store a threshold voltage representative of a synaptic importance value of the synapse connected to the neuron in the artificial neural network.

Neuromorphic memory circuit and method of neurogenesis for an artificial neural network

A prediction system for simulating effects of a real-world event can be used for autonomous driving. In operation, the system receives input data regarding a complex system (e.g., roadways) and various real-world events. A full-scale network is constructed of the complex system, such that nodes represent road intersections and edges between nodes represent road segments linking the road intersections. The network is reduced is scaled down to generate a multi-layer model of the complex system. Each layer in the model is simulated to identify equilibrium flows, with the model thereafter destabilized by applying stimuli to reflect the real-world event. An autonomous vehicle can then be caused to chart and traverse a road path based on road segments and intersections that are least affected by the real-world event.

Prediction system for simulating the effects of a real-world event

Described is a system for health assessment. The system is implemented on a mobile device having at least one of an accelerometer, a geographic location sensor, and a camera. In operation, the system obtains sensor data related to an operator of the mobile device from one of the sensors. A network of networks (NoN) is generated based on the sensor data, the NoN having a plurality of layers with linked nodes. Tuples are thereafter generated. Each tuple contains a node from each layer that optimizes importance, diversity, and coherence. Storylines are created based on the tuples that solves a longest path problem for each tuple. The storylines track multiple symptom progressions of the operator. Finally, a disease prediction of the operator is provided based on the storylines.

System and method for health assessment on smartphones

An autonomous navigation system for a vehicle includes a controller configured to control the vehicle, sensors configured to detect objects in a path of the vehicle, nonvolatile memory including an artificial neural network configured to classify the objects detected by the sensors, and a processor. The artificial neural network includes a series of neurons in each of an input layer, at least one hidden layer, and an output layer. The memory includes instructions which, when executed by the processor, cause the processor to train the artificial neural network on a first task, identify, utilizing a contrastive excitation backpropagation algorithm, important neurons for the first task, identify, utilizing a learning algorithm, important synapses between the neurons for the first task based on the important neurons identified, and rigidify the important synapses to achieve selective plasticity of the series of neurons in the artificial neural network.

Artificial neural networks having attention-based selective plasticity and methods of training the same

Described is an audio classification system for classifying audio signals. In operation, the system extracts salient patches from an intensity spectrogram of an audio signal. Thereafter, multi-scale global average pooling (GAP) features are extracted for all salient patches. The GAP features are clustered, with each cluster becoming a key attribute. A test audio signal can then be mapped onto a histogram of key attributes. Based on the histogram, the test audio signal can then be classified as a sound class, allowing for operation of a device based on the classification of the sound class.

System and method for audio classification based on unsupervised attribute learning

A method for determining a vehicle system prognosis includes detecting a predetermined characteristic of a vehicle with one or more sensors, receiving a plurality of sensor signals from the one or more sensors and determining an input time series of data based on the sensor signals, clustering a matrix of time series data, generated from the input time series of data, into a predetermined number of hyperplanes, extracting extracted features that are indicative of an operation of a vehicle system from a sparse temporal matrix based on data point behavior with respect to two or more hyperplanes within the sparse temporal matrix and determining an operational status of the vehicle system based on the extracted features, the sparse temporal matrix being based on the predetermined number of hyperplanes; and communicating the operational status of the vehicle system to an operator or crew member of the vehicle.

Vehicle system prognosis device and method

Growing community of inventors

Thousand Oaks, CA, United States of America

Charles E Martin