The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 30, 2024

Filed:

Nov. 12, 2020
Applicant:

Meta Platforms, Inc., Menlo Park, CA (US);

Inventors:

Liangzhen Lai, Fremont, CA (US);

Yu Hsin Chen, Santa Clara, CA (US);

Vikas Chandra, Fremont, CA (US);

Assignee:

Meta Platforms, Inc., Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 20/00 (2019.01); G06F 17/15 (2006.01); G06F 17/16 (2006.01); G06N 3/08 (2023.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06F 17/15 (2013.01); G06F 17/16 (2013.01); G06N 20/00 (2019.01);
Abstract

In one embodiment, a method for machine learning acceleration includes receiving instructions to perform convolution on an input tensor using a filter tensor, determining that the size of a first dimension of the input tensor is less than a processing capacity of each of multiple subarrays of computation units in a tensor processor, selecting a second dimension of the input tensor along which to perform the convolution, selecting, based on the second dimension, one or more dimensions of the filter tensor, generating (1) first instructions for reading, using vector read operations, activation elements in the input tensor organized such that elements with different values in the second dimension are stored contiguously in memory, and (2) second instructions for reading weights of the filter tensor along the selected one or more dimensions, and using the first and second instructions to provide the activation elements and the weights to the subarrays.


Find Patent Forward Citations

Loading…