The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 19, 2023
Filed:
Apr. 22, 2021
Habana Labs Ltd., Caesarea, IL;
Oren Kaidar, Binyamina-Givat Ada, IL;
Oded Gabbay, Raanana, IL;
HABANA LABS LTD., Caesarea, IL;
Abstract
An apparatus for Machine Learning (ML) processing includes computational engines and a Central Processing Unit (CPU). The CPU is configured to receive a work plan for processing one or more samples in accordance with a ML model represented by a corresponding ML graph. The work plan specifies jobs required for executing at least a subgraph of the ML graph by the computational engines, the at least subgraph includes multiple inputs, and is executable independently of other parts of the ML graph when the inputs are valid. The CPU is further configured to pre-process only a partial subset of the jobs in the work plan corresponding to the at least subgraph, for producing a group of pre-processed jobs that are required for executing part of the at least subgraph based on the one or more samples, and to submit the pre-processed jobs in the group to the computational engines for execution.