The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 02, 2025

Filed:

Jul. 15, 2021
Applicants:

Ntt Research, Inc., Sunnyvale, CA (US);

The Board of Trustees of the Leland Stanford Junior University, Stanford, CA (US);

Inventors:

Hidenori Tanaka, Sunnyvale, CA (US);

Daniel Kunin, Stanford, CA (US);

Daniel L. K. Yamins, Sunnyvale, CA (US);

Surya Ganguli, Stanford, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/082 (2023.01); G06N 3/04 (2023.01);
U.S. Cl.
CPC ...
G06N 3/082 (2013.01); G06N 3/04 (2013.01);
Abstract

A system and method to prune parameters of a neural network at initialization uses iterative conserving synaptic flow that saves time, memory and energy both during training and at test time of the neural network. The result of the disclosed pruning system and method are highly sparse trainable subnetworks at initialization, without training and without ever looking at the data (a data agnostic pruning system and method). The pruning system and method preserves the total flow of synaptic strengths through the network at initialization subject to a sparsity constraint.


Find Patent Forward Citations

Loading…