The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 22, 2022

Filed:

Dec. 19, 2018
Applicant:

Cavium, Llc, Santa Clara, CA (US);

Inventors:

Avinash Sodani, San Jose, CA (US);

Ulf Hanebutte, Gig Harbor, WA (US);

Senad Durakovic, Palo Alto, CA (US);

Hamid Reza Ghasemi, Sunnyvale, CA (US);

Chia-Hsin Chen, Santa Clara, CA (US);

Assignee:

Marvell Asia Pte Ltd, Singapore, SG;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 9/00 (2006.01); G06F 9/38 (2018.01); G06N 20/00 (2019.01); G06N 20/10 (2019.01); G06F 9/30 (2018.01); G06F 17/16 (2006.01); G06F 15/78 (2006.01); G06F 15/80 (2006.01); G06N 20/20 (2019.01); G06N 5/04 (2006.01);
U.S. Cl.
CPC ...
G06F 9/3879 (2013.01); G06F 9/30174 (2013.01); G06F 9/3836 (2013.01); G06F 9/3851 (2013.01); G06F 9/3877 (2013.01); G06F 15/7807 (2013.01); G06F 17/16 (2013.01); G06N 20/00 (2019.01); G06N 20/10 (2019.01); G06F 9/3001 (2013.01); G06F 15/7864 (2013.01); G06F 15/8023 (2013.01); G06F 2212/602 (2013.01); G06N 5/04 (2013.01); G06N 20/20 (2019.01);
Abstract

A programmable hardware system for machine learning (ML) includes a core and an inference engine. The core receives commands from a host. The commands are in a first instruction set architecture (ISA) format. The core divides the commands into a first set for performance-critical operations, in the first ISA format, and a second set of performance non-critical operations, in the first ISA format. The core executes the second set to perform the performance non-critical operations of the ML operations and streams the first set to inference engine. The inference engine generates a stream of the first set of commands in a second ISA format based on the first set of commands in the first ISA format. The first set of commands in the second ISA format programs components within the inference engine to execute the ML operations to infer data.


Find Patent Forward Citations

Loading…