Tencent Technology (shenzhen) Company Limited

Huawei Technologies Co., Limited

Zhaopeng Tu

Longyue Wang

Tong Zhang

Shuming Shi

Xing Xing Wang

Hang Li

Xing Wang

Xiaohua Liu

Baosong Yang

Xiao Ling Chen

Yang Liu

Li Qian

Xueyan Huang

Yong Cheng

Jian Li

Hao Zhou

Wenbin Jiang

Zhengdong Lu

Fandong Meng

Lifeng Shang

Junjie Zhai

Xiang Kong

Xinwei Geng

Jie Hao

Jinhua Du

Embodiments of this application disclose a neural network model training method, a machine translation method, a computer device, and a storage medium. The method includes: obtaining a training sample set including a training sample and a standard tag vector corresponding to the training sample; inputting the training sample into a neural network model including a plurality of attention networks to obtain a feature fusion vector; obtaining a predicted tag vector according to the feature fusion vector, and performing adjustment on a model parameter of the neural network model until a convergence condition is met to obtain a target neural network model.

Model training method, machine translation method, computer device, and storage medium

Embodiments of this application disclose a sequence model processing method and apparatus, to improve a task execution effect of a sequence model. The method includes: inputting a source sequence into an encoder side of a sequence model, the encoder side including a self-attention encoder and a temporal encoder; encoding the source sequence by using the temporal encoder, to obtain a first encoding result, the first encoding result including time series information obtained by performing time series modeling on the source sequence; and encoding the source sequence by using the self-attention encoder, to obtain a second encoding result; inputting a target sequence, the first encoding result, and the second encoding result into a decoder side of the sequence model; and decoding the target sequence, the first encoding result, and the second encoding result by using the decoder side, and outputting a decoding result obtained after the decoding.

Sequence model processing method and apparatus

A text translation method includes: obtaining a to-be-translated text sequence; encoding the to-be-translated text sequence, to obtain a first hidden state sequence; obtaining a first state vector; generating a second hidden state sequence according to the first state vector and the first hidden state sequence; generating a context vector corresponding to a current word according to the second hidden state sequence and the first state vector; determining a second target word according to the context vector, the first state vector, and a first target word. The first state vector corresponds to a predecessor word of a current word, the current word is a to-be-translated word in the source language text, the predecessor word is a word that has been translated in the source language text. The first target word is a translation result of a predecessor word, and the second target word is a translation result of the current word.

Text translation method and apparatus, and storage medium

Embodiments of this disclosure disclose an information processing method, apparatus and a non-transitory computer readable medium. The method includes: obtaining a target text sequence corresponding to to-be-processed text information; obtaining a context vector according to the target text sequence; determining a logical similarity corresponding to the target text sequence according to the context vector and the target text sequence; and encoding the target text sequence corresponding to target text information by using the logical similarity to obtain a text encoding result. In this embodiment of this disclosure, a context vector related to a discrete sequence is used to encode the discrete sequence, to strengthen the dependence between elements in the discrete sequence, thereby enhancing the performance of a neural network model and improving the learning capability of the model.

Information processing method and apparatus, and storage medium

A translation method is provided, including: encoding to-be-processed text information to obtain a source vector representation sequence, the to-be-processed text information belonging to a first language; obtaining a source context vector corresponding to a first instance according to the source vector representation sequence, the source context vector indicating to-be-processed source content in the to-be-processed text information at the first instance; determining a translation vector according to the source vector representation sequence and the source context vector; and decoding the translation vector and the source context vector, to obtain target information of the first instance, the target information belonging to a second language.

Translation method, target information determining method, related apparatus, and storage medium

A translation model training method for a computer device includes obtaining a training sample set, the training sample set including a plurality of training samples. Each training sample is a training sample pair having a training input sample in a first language and a training output sample in a second language. The method also includes determining a disturbance sample set corresponding to each training sample in the training sample set, the disturbance sample set comprising at least one disturbance sample, and a semantic similarity between the disturbance sample and the corresponding training sample being greater than a first preset value; and training an initial translation model by using the plurality of training samples and the disturbance sample set corresponding to each training sample to obtain a target translation model, such that the training output sample remains same for the disturbance sample and the corresponding training sample.

Translation model training method, sentence translation method, device, and storage medium

The present disclosure describes a method, apparatus, and storage medium for generating network representation for a neural network. The method includes obtaining a source-side vector sequence corresponding to an input sequence. The method further includes performing linear transformation on the source-side vector sequence, to obtain a request vector sequence, a key vector sequence, and a value vector sequence corresponding to the source-side vector sequence; calculating a logical similarity between the request vector sequence and the key vector sequence; constructing a local strength matrix according to the request vector sequence; performing nonlinear transformation based on the logical similarity and the local strength matrix, to obtain a local strength attention weight distribution corresponding to elements in the input sequence; and fusing value vectors in the value vector sequence according to the local strength attention weight distribution, to obtain a network representation sequence corresponding to the input sequence.

Method, apparatus, and storage medium for generating network representation for neural network

This application relates to a machine translation method performed at a computer device. The method includes: obtaining an original source text and a reconstructed source text; performing semantic encoding on the original source text, to obtain a source vector sequence; sequentially decoding the source vector sequence to obtain target vectors by performing decoding on the source vector sequence at a current time according to a word vector of a candidate target word determined at a previous time, determining a candidate target word at the current time according to a target vector at the current time, and forming a target vector sequence accordingly; performing reconstruction assessment on the source vector sequence and the target vector sequence using the reconstructed source text, to obtain reconstruction scores corresponding to the candidate target words; and generating a target text according to the reconstruction scores and the candidate target words.

Text translation method and apparatus, storage medium, and computer device

A content explanation method and apparatus applied to content explanation includes identifying, by a content explanation apparatus, an emotion of the user, when identifying a negative emotion showing that the user is confused about delivered multimedia information, obtaining, by the content explanation apparatus, a target representation manner of target content in a target intelligence type, where the target content is content about which the user is confused in the multimedia information delivered to the user by an information delivery apparatus associated with the content explanation apparatus, and presenting, by the content explanation apparatus, the target content to the user in the target representation manner.

Content explanation method and apparatus

The present application relates to natural language processing and discloses a sequence conversion method. The method includes: obtaining a source sequence from an input signal; converting the source sequence into one or more source context vectors; obtaining a target context vector corresponding to each source context vector; combining the target context vectors to obtain the target sequence; and outputting the target sequence. A weight vector is applied on a source context vector and a reference context vector, to obtain a target context vector, wherein the weight of one or more elements in the source context vector associated with notional words or weight of a function word in the target context vector is increased. The source sequence and the target sequence are representations of natural language contents. The claimed process improves faithfulness of converting the source sequence to the target sequence.

Sequence conversion method and apparatus in natural language processing based on adjusting a weight associated with each word

A machine translation method and an apparatus are provided. The method includes: obtaining, when translating a word fragment from a first language into a second language, a source representation vector of the word fragment. The source representation vector of the word fragment represents the word fragment in the first language. The method also includes obtaining a historical translation vector of the word fragment by querying historical translation information according to the source representation vector of the word fragment. The historical translation vector of the word fragment represents a historical translation situation corresponding to the word fragment. The method further includes translating the word fragment according to the historical translation vector of the word fragment.

Machine translation method, apparatus, computer device, and storage medium

A translation model based training method is provided for a computer device. The method includes inputting a source sentence to a translation model, to obtain a target sentence outputted by the translation model; determining a fidelity of the target sentence to the source sentence; using the target sentence and a reference sentence as input of a discriminator model, using the fidelity as output of the discriminator model, and training the discriminator model on a performance of calculating a similarity between the target sentence and the reference sentence; outputting the similarity by using the discriminator model; and using the source sentence as input of the translation model, using the target sentence as output of the translation model, and using the similarity as a weight coefficient, and training the translation model on a performance of outputting the corresponding target sentence according to the input source sentence.

Translation model based training method and translation method, computer device, and storage medium

Embodiments of the present invention provide a translation method and apparatus, and relate to the field of machine translation. The method includes: obtaining a to-be-translated sentence, where the to-be-translated sentence is a sentence expressed in a first language; determining a first named entity set in the to-be-translated sentence, and an entity type of each first named entity in the first named entity set; determining, based on the first named entity set and the entity type of each first named entity, a second named entity set expressed in a second language; determining a source semantic template of the to-be-translated sentence, and obtaining a target semantic template corresponding to the source semantic template from a semantic template correspondence; and determining a target translation sentence based on the second named entity set and the target semantic template.

Translation method and apparatus

A sequence conversion method includes receiving a source sequence, converting the source sequence into a source vector representation sequence, obtaining at least two candidate target sequences and a translation probability value of each of the at least two candidate target sequences according to the source vector representation sequence, adjusting the translation probability value of each candidate target sequence, selecting an output target sequence from the at least two candidate target sequences according to an adjusted translation probability value of each candidate target sequence, and outputting the output target sequence. Hence, loyalty of a target sequence to a source sequence can be improved during sequence conversion.

Sequence translation probability adjustment

A syntax analysis method and apparatus are disclosed. The method includes: obtaining a source language sentence that is a translation of a target language sentence (S); determining instances of state transition for the target language sentence according to the source language sentence and a correspondence between words of the target language sentence and words of the source language sentence (S); and generating a syntax tree of the target language sentence according to the instances of state transition for the target language sentence (S). The syntax analysis method and apparatus can improve efficiency of syntax analysis.

Growing community of inventors

Shenzhen, China

Zhaopeng Tu