National Technology & Engineering Solutions of Sandia, LLC

Lewis Rhodes Labs, Inc.

Craig Michael Vineyard

James Bradley Aimone

Stephen Joseph Verzi

David R Follett

William Mark Severa

Pamela L Follett

Frances S Chance

John H Naegle

Sam Green

Anomaly detection for streaming data is provided. A spiking neural network receives inputs of streaming data, wherein each input is contained within a number of neighborhoods and converts the inputs into phase-coded spikes. A median value of each input is calculated for each size neighborhood containing the input, and an absolute difference of each input from its median value is calculated for each size neighborhood. From the absolute differences, a median absolute difference (MAD) value of each input is calculated for each size neighborhood. It is determined whether the MAD value for any size neighborhood exceeds a respective threshold. If the MAD value exceeds its threshold, an anomaly indication is output for the input. If none of the MAD values for the neighborhoods exceeds its threshold, a normal indication is output for the input.

Sequence-based anomaly detection with hierarchical spiking neural networks

A method for matching neural network layouts to hardware architectures is provided. The method comprises iteratively: holding neural network parameters constant while changing a hardware architecture parameters, calculating a first loss value for a combination of the neural network parameters and hardware architecture parameters according to a gradient-based differentiable function within specified resource constraints, holding the hardware architecture parameters constant while changing the neural network parameters, calculating a second loss value for a new combination of parameters within the specified resource constraints, and combining the first loss value and the second loss value to calculate a combined loss value. The above iterative steps are stopped when the combined loss value reaches a specified threshold, and an optimal combination of neural network parameters and hardware architecture parameters is determined according to the combined loss value.

Algorithmic architecture co-design and exploration

A method for increasing a speed and efficiency of a computer when performing machine learning using spiking neural networks. The method includes computer-implemented operations; that is, operations that are solely executed on a computer. The method includes receiving, in a spiking neural network, a plurality of input values upon which a machine learning algorithm is based. The method also includes correlating, for each input value, a corresponding response speed of a corresponding neuron to a corresponding equivalence relationship between the input value to a corresponding latency of the corresponding neuron. Neurons that trigger faster than other neurons represent close relationships between input values and neuron latencies. Latencies of the neurons represent data points used in performing the machine learning. A plurality of equivalence relationships are formed as a result of correlating. The method includes performing the machine learning using the plurality of equivalence relationships.

Devices and methods for increasing the speed or power efficiency of a computer when performing machine learning using spiking neural networks

Detecting anomalies with a spiking neural network is provided. An input layer receives a number of inputs and converts them into phase-coded spikes, wherein each input is contained within a number of progressively larger neighborhoods of surrounding inputs. From the phase-coded spikes, a median value of each input is computed for each size neighborhood. An absolute difference of each input from its median value is computed for each size neighborhood. A median absolute difference (MAD) of each input is computed for each size neighborhood. For each input, an adaptive median filter (AMF) determines if a MAD for any size neighborhood exceeds a respective threshold. If one or more neighborhoods exceeds its threshold, the AMF outputs the median value of the input for the smallest neighborhood. If none of the neighborhoods exceeds the threshold, the AMF outputs the original value of the input.

Anomaly detection with spiking neural networks

A method for processing data is provided. Data is identified by a computer system. The data is processed in parallel by the computer system using temporal transformations to form pieces of temporal data. The pieces of temporal data are placed by the computer system in an order as the pieces of temporal data are generated by the temporal transformations to form a sequence of temporal data. The order of the sequence is based on a priority of when the pieces of temporal data should be processed, enabling performing an action.

Growing community of inventors

Albuquerque, NM, United States of America

Craig Michael Vineyard