The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 24, 2023
Filed:
Feb. 07, 2019
Applicant:
Royal Bank of Canada, Montreal, CA;
Inventors:
Luyu Wang, Toronto, CA;
Weiguang Ding, Toronto, CA;
Ruitong Huang, Toronto, CA;
Yanshuai Cao, Toronto, CA;
Yik Chau Lui, Toronto, CA;
Assignee:
ROYAL BANK OF CANADA, Toronto, CA;
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2006.01); G06F 17/13 (2006.01); G06F 21/57 (2013.01); G06F 21/55 (2013.01);
U.S. Cl.
CPC ...
G06N 3/082 (2013.01); G06F 17/13 (2013.01); G06F 21/552 (2013.01); G06F 21/577 (2013.01); G06N 3/084 (2013.01);
Abstract
Systems, methods, and computer readable media are described to train a compressed neural network with high robustness. The neural network is first adversarially pre-trained with both original data as well as data perturbed by adversarial attacks for some epochs, then 'unimportant' weights or filters are pruned through criteria based on their magnitudes or other method (e.g., Taylor approximation of the loss function), and the pruned neural network is retrained with both clean and perturbed data for more epochs.