The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 03, 2026
Filed:
Jun. 25, 2021
Aref Jafari, Waterloo, CA;
Mehdi Rezagholizadeh, Montreal, CA;
Ali Ghodsi, Waterloo, CA;
HUAWEI TECHNOLOGIES CO., LTD., Shenzhen, CN;
Abstract
Methods and systems are provided for compressing a deep neural network (NN) model using knowledge distillation. The method includes training a student NN model to minimize a first loss between student model output values generated by the student NN model for a set of original input values and teacher model output values generated by a teacher NN model for the set of original input values, generating, for at least some of the original input values, a respective perturbed value that maximizes a second loss between an output value generated by the student NN model and an output value generated by the teacher NN model, adding the perturbed values to the set of original input values to provide a set of augmented input values and retraining the student NN model using the set of augmented input values.
Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile