Ai-based pattern identification transformer

Abstract

Apparatus and methods for a pattern identification transformer neural network is provided. The pattern identification transformer neural network may be able to learn from relatively small numbers of data elements. The pattern identification transformer neural network may function in similar method to the way humans transform data points. As such, the pattern identification transformer neural network may be able to learn patterns from a small number of examples and determine what attributes are helpful from a single experience. The pattern identification transformer neural networks may include a multi-head attention module, a normalize module and a feed forward neural network. The multi-head attention module may receive vectors that correspond to experiences. The normalize module may normalize the received vectors. The feed forward neural network may incorporate the received vectors into the neural network.