The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 06, 2026
Filed:
May. 27, 2022
Knowledge distillation method based on regression task and computing device for executing the method
Samsung Sds Co., Ltd., Seoul, KR;
Joonho Lee, Seoul, KR;
Jae-Young Yang, Seoul, KR;
Dae-Yeol Shim, Seoul, KR;
Mee-Kyoung Park, Seoul, KR;
Chang-Hyun Baek, Seoul, KR;
Jun-Ho Kang, Seoul, KR;
Sang-Bum Cho, Seoul, KR;
Chang-Hoon Kim, Seoul, KR;
Kyu-Jung Kim, Seoul, KR;
SAMSUNG SDS CO., LTD., Seoul, KR;
Abstract
A knowledge distillation method based on a regression task according to an embodiment of the present disclosure includes training a first deep neural network model that is a teacher model including a first encoder and a first decoder, constructing a second deep neural network model that is a student model including a second encoder and a second decoder according to a preset constraint of a target system and initializing parameters of the second deep neural network model, performing a first knowledge distillation operation on the second encoder of the second deep neural network model based on the trained first deep neural network model, and performing a second knowledge distillation operation on the second encoder and the second decoder of the second deep neural network model based on the trained first deep neural network model.