The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 30, 2023
Filed:
Dec. 13, 2018
Electronics and Telecommunications Research Institute, Daejeon, KR;
Seung-Hyun Cho, Daejeon, KR;
Youn-Hee Kim, Daejeon, KR;
Jin-Wuk Seok, Daejeon, KR;
Joo-Young Lee, Daejeon, KR;
Woong Lim, Daejeon, KR;
Jong-Ho Kim, Daejeon, KR;
Dae-Yeol Lee, Daejeon, KR;
Se-Yoon Jeong, Daejeon, KR;
Hui-Yong Kim, Daejeon, KR;
Jin-Soo Choi, Daejeon, KR;
Je-Won Kang, Seoul, KR;
Electronics and Telecommunications Research Institute, Daejeon, KR;
Abstract
Disclosed herein are a method and apparatus for compressing learning parameters for training of a deep-learning model and transmitting the compressed parameters in a distributed processing environment. Multiple electronic devices in the distributed processing system perform training of a neural network. By performing training, parameters are updated. The electronic device may share the updated parameter thereof with additional electronic devices. In order to efficiently share the parameter, the residual of the parameter is provided to the additional electronic devices. When the residual of the parameter is provided, the additional electronic devices update the parameter using the residual of the parameter.