The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 17, 2023

Filed:

Mar. 24, 2020
Applicant:

Beijing Xiaomi Intelligent Technology Co., Ltd., Beijing, CN;

Inventors:

Xiang Li, Beijing, CN;

Yuhui Sun, Beijing, CN;

Jingwei Li, Beijing, CN;

Jialiang Jiang, Beijing, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/04 (2006.01); G06F 17/18 (2006.01); G06N 3/08 (2006.01); G06F 40/58 (2020.01);
U.S. Cl.
CPC ...
G06N 3/0454 (2013.01); G06F 17/18 (2013.01); G06F 40/58 (2020.01); G06N 3/08 (2013.01);
Abstract

A method for compressing a neural network model includes: obtaining a first trained teacher model and a second trained teacher model based on N training samples, N being a positive integer greater than 1; for each of the N training samples, determining a first guide component of the first teacher model and a second guide component of the second teacher model respectively, determining a sub optimization target corresponding to the training sample and configured to optimize a student model according to the first guide component and the second guide component, and determining a joint optimization target based on each of the N training samples and a sub optimization target corresponding to the training sample; and training the student model based on the joint optimization target.


Find Patent Forward Citations

Loading…