Beijing Xiaomi Intelligent Technology Co., Ltd.

Beijing Xiaomi Mobile Software Co., Ltd.

Jialiang Jiang

Jing Li

Yuhui Sun

Jianwei Cui

Jingwei Li

A method includes: a bidirectional translation model to be trained and training data are acquired, the training data including a source corpus and a target corpus corresponding to the source corpus; the bidirectional translation model is trained for N cycles, each cycle of training including a forward translation process of translating the source corpus into a pseudo target corpus and a reverse translation process of translating the pseudo target corpus into a pseudo source corpus and N being a positive integer greater than 1; a forward translation similarity and a reverse translation similarity are acquired; and when a sum of the forward translation similarity and the reverse translation similarity converges, it is determined that training of the bidirectional translation model is completed, where the training completed bidirectional translation model is used to perform translating.

Method, device and storage medium for training bidirectional machine translation model using sum of forward and reverse translation similarities

A method for compressing a neural network model includes: obtaining a first trained teacher model and a second trained teacher model based on N training samples, N being a positive integer greater than 1; for each of the N training samples, determining a first guide component of the first teacher model and a second guide component of the second teacher model respectively, determining a sub optimization target corresponding to the training sample and configured to optimize a student model according to the first guide component and the second guide component, and determining a joint optimization target based on each of the N training samples and a sub optimization target corresponding to the training sample; and training the student model based on the joint optimization target.

Method and device for compressing a neural network model for machine translation and storage medium

A method for compressing a neural network model, includes: obtaining a set of training samples including a plurality of pairs of training samples, each pair of the training samples including source data and target data corresponding to the source data; training an original teacher model by using the source data as an input and using the target data as verification data; training intermediate teacher models based on the set of training samples and the original teacher model, one or more intermediate teacher models forming a set of teacher models; training multiple candidate student models based on the set of training samples, the original teacher model, and the set of teacher models, the multiple candidate student models forming a set of student models; and selecting a candidate student model of the multiple candidate student models as a target student model according to training results of the multiple candidate student models.

Growing community of inventors

Beijing, China

Jialiang Jiang