The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 12, 2023

Filed:

Jul. 24, 2019
Applicant:

Alibaba Group Holding Limited, Grand Cayman, KY;

Inventors:

Maohua Zhu, San Mateo, CA (US);

Zhenyu Gu, San Mateo, CA (US);

Yuan Xie, San Mateo, CA (US);

Assignee:

Alibaba Group Holding Limited, Grand Cayman, KY;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2023.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01);
Abstract

The present disclosure relates to systems and methods for providing block-wise sparsity in neural networks. In one implementation, a system for providing block-wise sparsity in a neural network may include at least one memory storing instructions and at least one processor configured to execute the instructions to: divide a matrix of weights associated with a neural network into a plurality of blocks; extract non-zero elements from one or more of the plurality of blocks; re-encode the extracted non-zero elements as vectors with associated coordinates of the extracted non-zero elements within the one or more blocks; enforce input sparsity in the neural network corresponding to the associated coordinates; and execute the neural network using the vectors and the enforced input sparsity.


Find Patent Forward Citations

Loading…