The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 15, 2024
Filed:
May. 27, 2021
Method and apparatus for generating hidden state in recurrent neural network for language processing
Tencent Technology (Shenzhen) Company Limited, Shenzhen, CN;
TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen, CN;
Abstract
A method and apparatus for generating a hidden state in a recurrent neural network for language processing are provided. The method includes: generating regional word vectors of at least two dimensions of a target word vector inputted at a first moment; combining the regional word vectors to obtain combined regional word vectors of at least two dimensions; performing aggregation transformation processing on the combined regional word vectors based on a feedforward neural network, to obtain an aggregated word vector corresponding to the target word vector; and generating a target hidden state corresponding to the target word vector based on the aggregated word vector.