The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 31, 2024
Filed:
Nov. 27, 2019
Amazon Technologies, Inc., Seattle, WA (US);
Animesh Jain, Sunnyvale, CA (US);
Yizhi Liu, Fremont, CA (US);
Hongbin Zheng, San Jose, CA (US);
Jeffrey T. Huynh, San Jose, CA (US);
Haichen Li, Campbell, CA (US);
Drazen Borkovic, Los Altos, CA (US);
Jindrich Zejda, Saratoga, CA (US);
Richard John Heaton, San Jose, CA (US);
Randy Renfu Huang, Morgan Hill, CA (US);
Zhi Chen, Santa Clara, CA (US);
Yida Wang, Palo Alto, CA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Methods and apparatuses for hierarchical partitioning of operators of a neural network for execution on an acceleration engine are provided. Neural networks are built in machine learning frameworks using neural network operators. The neural network operators are compiled into executable code for the acceleration engine. Development of new framework-level operators can exceed the capability to map the newly developed framework-level operators onto the acceleration engine. To enable neural networks to be executed on an acceleration engine, hierarchical partitioning can be used to partition the operators of the neural network. The hierarchical partitioning can identify operators that are supported by a compiler for execution on the acceleration engine, operators to be compiled for execution on a host processor, and operators to be executed on the machine learning framework.