National Institute of Information and Communications Technology, Incorporated

Rui Wang

Eiichiro Sumita

Masao Uchiyama

Kehai Chen

Improvement is made in performance of a trained neural network that uses positional information indicating a position at which each token included in an input sequence is present in the input sequence. An inferencer includes a first generation unit that generates an intermediate sentence representation based on a first sentence representation having information indicating a value of each token included in the input sequence and first positional information indicating a position at which each token is present in the input sequence; a second generation unit that generates second positional information by modifying the first positional information based on the first sentence representation and the intermediate sentence representation, and that generates a hidden state representation based on the second positional information and the intermediate sentence representation; and a third generation unit that generates a second sentence representation based on the intermediate sentence representation and the hidden state representation.

Growing community of inventors

Koganei, Japan

Rui Wang