Information processing system and method

Abstract

According to one embodiment, a first key and a first value are stored in a memory device. Each time a self-attention input is input, a self-attention layer executes the following processing. The self-attention layer generates a query, a second key, and a second value based on the self-attention input. The self-attention layer stores the generated second key and second value into the memory device. The self-attention layer executes a first calculation to acquire an attention score by an inner product of the query and a key matrix including the first key and the second key stored in the memory device. The self-attention layer executes a second calculation to calculate an inner product of the attention score and a value matrix including the first value and the second value stored in the memory device. The self-attention layer outputs a result of the second calculation.