Beijing Baidu Netcom Science Technology Co., Ltd

Zhengjie Huang

Shikun Feng

Shiwei Huang

Xuyi Chen

Chenhui Li

Weibin Li

Bo Ke

A data processing method, and a data processing model and a training method therefor are provided, and relate to the field of artificial intelligence, and specifically, to natural language processing, deep learning technologies, and large model technologies. An implementation solution includes: determining input data, where the input data includes a plurality of tokens; determining a correlation between each of the plurality of tokens and each of a plurality of expert networks based on a gating matrix, where the plurality of expert networks are used to reinforce the plurality of tokens; allocating the plurality of tokens to the plurality of expert networks in a uniform manner based on the correlation and a preset capacity of each expert network, to reinforce the plurality of tokens; and determining a data processing result based on the plurality of reinforced tokens.

Growing community of inventors

Beijing, China

Zhengjie Huang