The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 19, 2023

Filed:

Jun. 16, 2020
Applicant:

National Tsing Hua University, Hsinchu, TW;

Inventors:

Meng-Fan Chang, Taichung, TW;

Wei-Hsing Huang, Hsinchu, TW;

Ta-Wei Liu, Hsinchu, TW;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/084 (2023.01); G06F 7/544 (2006.01); G06N 3/063 (2023.01); G06N 3/04 (2023.01);
U.S. Cl.
CPC ...
G06N 3/084 (2013.01); G06F 7/5443 (2013.01); G06F 7/5446 (2013.01); G06N 3/04 (2013.01); G06N 3/063 (2013.01);
Abstract

A dynamic gradient calibration method for a computing-in-memory neural network is performed to update a plurality of weights in a computing-in-memory circuit according to a plurality of inputs corresponding to a correct answer. A forward operating step includes performing a bit wise multiply-accumulate operation on a plurality of divided inputs and a plurality of divided weights to generate a plurality of multiply-accumulate values, and performing a clamping function on the multiply-accumulate values to generate a plurality of clamped multiply-accumulate values according to a predetermined upper bound value, and comparing the clamped multiply-accumulate values with the correct answer to generate a plurality of loss values. A backward operating step includes performing a partial differential operation on the loss values relative to the weights to generate a weight-based gradient. The weights are updated according to the weight-based gradient.


Find Patent Forward Citations

Loading…