The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 21, 2026

Filed:

Nov. 22, 2021
Applicant:

Montage Technology Co., Ltd., Shanghai, CN;

Inventors:

Zhen Dong, Shanghai, CN;

Yuanfei Nie, Shanghai, CN;

Huan Feng, Shanghai, CN;

Assignee:
Attorneys:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/084 (2023.01); G06N 3/045 (2023.01); G06N 3/0464 (2023.01); G06N 3/0495 (2023.01); G06N 3/082 (2023.01); G06N 3/09 (2023.01); G06N 3/063 (2023.01);
U.S. Cl.
CPC ...
G06N 3/084 (2013.01);
Abstract

A method for compressing a neural network includes: obtaining a neural network including a plurality of parameters to be compressed; dividing the parameters into J blocks; compressing a jblock with Kcompression ratios to generate Koperation branches; obtaining Kweighting factors; replacing the jblock with the Koperation branches weighted by the Kweighting factors to generate a replacement neural network; performing forward propagation to the replacement neural network, a weighted sum operation being performed on Koperation results generated by the Koperation branches with the Kweighting factors and a result of the operation being used as an output; performing backward propagation to the replacement neural network, updated values of the Kweighting factors being calculated based on a model loss; and determining an operation branch corresponding to the maximum value of the updated values of the Kweighting factors as a compressed jblock.


Find Patent Forward Citations

Loading…