The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 06, 2024
Filed:
Jan. 24, 2022
Sambanova Systems, Inc., Palo Alto, CA (US);
Martin Russell Raumann, San Leandro, CA (US);
Qi Zheng, Fremont, CA (US);
Bandish B. Shah, San Francisco, CA (US);
Ravinder Kumar, Fremont, CA (US);
Kin Hing Leung, Cupertino, CA (US);
Sumti Jairath, Santa Clara, CA (US);
Gregory Frederick Grohoski, Bee Cave, TX (US);
SambaNova Systems, Inc., Palo Alto, CA (US);
Abstract
A system for training parameters of a neural network includes a processing node with a processor reconfigurable at a first level of configuration granularity and a controller reconfigurable at a finer level of configuration granularity. The processor is configured to execute a first dataflow segment of the neural network with training data to generate a predicted output value using a set of neural network parameters, calculate a first intermediate result for a parameter based on the predicted output value, a target output value, and a parameter gradient, and provide the first intermediate result to the controller. The controller is configured to receive a second intermediate result over a network, and execute a second dataflow segment, dependent upon the first intermediate result and the second intermediate result, to generate a third intermediate result indicative of an update of the parameter.