Beijing Baidu Netcom Science and Technology Co., Ltd.

Beijing Baidu Netcom Science Technology Co., Ltd

Shikun Feng

Haifeng Wang

Yu Sun

Hua Wu

Hao Tian

Jingzhou He

Shuohuan Wang

Kunsheng Zhou

Lei Shi

Yukun Li

Chao Pang

Siyu Ding

Shiwei Huang

Yanbin Zhao

Junyuan Shang

Chenhui Li

Xuyi Chen

Zhengjie Huang

Weibin Li

Bo Ke

Zhifan Zhu

A data processing method, and a data processing model and a training method therefor are provided, and relate to the field of artificial intelligence, and specifically, to natural language processing, deep learning technologies, and large model technologies. An implementation solution includes: determining input data, where the input data includes a plurality of tokens; determining a correlation between each of the plurality of tokens and each of a plurality of expert networks based on a gating matrix, where the plurality of expert networks are used to reinforce the plurality of tokens; allocating the plurality of tokens to the plurality of expert networks in a uniform manner based on the correlation and a preset capacity of each expert network, to reinforce the plurality of tokens; and determining a data processing result based on the plurality of reinforced tokens.

Data processing

The present application provides a method of training a natural language processing model, which relates to a field of artificial intelligence, and in particular to a field of natural language processing. A specific implementation scheme includes: performing a semantic learning for multi-tasks on an input text, so as to obtain a semantic feature for the multi-tasks, wherein the multi-tasks include a plurality of branch tasks; performing a feature learning for each branch task based on the semantic feature, so as to obtain a first output result for each branch task; calculating a loss for each branch task according to the first output result for the branch task; and adjusting a parameter of the natural language processing model according to the loss for each branch task. The present application further provides a method of processing a natural language, an electronic device, and a storage medium.

Method and apparatus of training natural language processing model, and method and apparatus of processing natural language

The present disclosure provides a method, apparatus, electronic device and storage medium for processing a semantic representation model, and relates to the field of artificial intelligence technologies. A specific implementation solution is: collecting a training corpus set including a plurality of training corpuses; training the semantic representation model using the training corpus set based on at least one of lexicon, grammar and semantics. In the present disclosure, by building the unsupervised or weakly-supervised training task at three different levels, namely, lexicon, grammar and semantics, the semantic representation model is enabled to learn knowledge at levels of lexicon, grammar and semantics from massive data, enhance the capability of universal semantic representation and improve the processing effect of the NLP task.

Method, apparatus, electronic device and storage medium for processing a semantic representation model

Disclosed are a method and an apparatus for constructing a binary feature dictionary. The method may include: extracting binary features from a corpus; calculating a preset statistic of each binary feature; and selecting a preset number of binary features in sequence according to the preset statistic to constitute the binary feature dictionary.

Method and apparatus for constructing binary feature dictionary

This disclosure discloses an artificial intelligence based method and apparatus for checking a text. An embodiment of the method comprises: lexing a first to-be-checked text and a second to-be-checked text respectively, determining word vectors of the lexed words to generate a first word vector sequence and a second word vector sequence; inputting the first word vector sequence and the second word vector sequence respectively into a pre-trained convolutional neural network containing at least one multi-scale convolutional layer, identifying vector sequences in a plurality of vector sequences outputted by a last multi-scale convolutional layer as eigenvector sequences, to obtain eigenvector sequence groups respectively corresponding to the texts; combining eigenvector sequences in each eigenvector sequence group to generate a combined eigenvector sequence; and analyzing the generated combined eigenvector sequences to determine whether the first text and the second text pass a similarity check. The embodiment improves the flexibility in checking a text.

Artificial intelligence based method and apparatus for checking text

Growing community of inventors

Beijing, China

Shikun Feng