The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 07, 2023

Filed:

Dec. 23, 2019
Applicant:

Meta Platforms, Inc., Menlo Park, CA (US);

Inventors:

Krishnakumar Narayanan Nair, Newark, CA (US);

Abdulkadir Utku Diril, Menlo Park, CA (US);

Yuchen Hao, Fremont, CA (US);

Thomas Mark Ulrich, Mountain View, CA (US);

Rakesh Komuravelli, Fremont, CA (US);

Ehsan Khish Ardestani Zadeh, San Jose, CA (US);

Martin Schatz, Seattle, WA (US);

Assignee:

Meta Platforms, Inc., Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 1/3234 (2019.01); G06F 12/0875 (2016.01); G06N 3/063 (2023.01); G06F 17/16 (2006.01); G06N 3/04 (2023.01);
U.S. Cl.
CPC ...
G06F 1/3275 (2013.01); G06F 12/0875 (2013.01); G06F 17/16 (2013.01); G06N 3/04 (2013.01); G06N 3/063 (2013.01); G06F 2212/45 (2013.01);
Abstract

A computer-implemented method may include (1) maintaining (a) a filter matrix in a filter cache included in a local memory device (LMD) included in a hardware accelerator, and (b) a plurality of activation matrices corresponding to different rows of an activation volume in an activation cache included in the LMD, (2) for each activation matrix, directing a matrix multiplication unit (MMU) included in the hardware accelerator to execute a matrix multiplication operation (MMU) using the filter matrix and the activation matrix, (3) loading an additional filter matrix into the filter cache, and (4) directing the MMU to execute a plurality of additional MMOs, each additional MMO using one filter matrix included in the filter cache and one activation matrix included in the activation cache, such that the MMU reuses the filter matrix for at least one additional MMO and uses the additional filter matrix for a different additional MMO.


Find Patent Forward Citations

Loading…