The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 02, 2022
Filed:
Nov. 11, 2020
Niamul Quader, Toronto, CA;
MD Ibrahim Khalil, Toronto, CA;
Juwei LU, North York, CA;
Peng Dai, Markham, CA;
Wei LI, Markham, CA;
Niamul Quader, Toronto, CA;
Md Ibrahim Khalil, Toronto, CA;
Juwei Lu, North York, CA;
Peng Dai, Markham, CA;
Wei Li, Markham, CA;
HUAWEI TECHNOLOGIES CO., LTD., Shenzhen, CN;
Abstract
Methods and systems for updating the weights of a set of convolution kernels of a convolutional layer of a neural network are described. A set of convolution kernels having attention-infused weights is generated by using an attention mechanism based on characteristics of the weights. For example, a set of location-based attention multipliers is applied to weights in the set of convolution kernels, a magnitude-based attention function is applied to the weights in the set of convolution kernels, or both. An output activation map is generated using the set of convolution kernels with attention-infused weights. A loss for the neural network is computed, and the gradient is back propagated to update the attention-infused weights of the convolution kernels.