The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 11, 2026

Filed:

Sep. 27, 2023
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Hongbin Zheng, San Jose, CA (US);

Ilya Minkin, Los Altos, CA (US);

Mohammad El-Shabani, Redwood City, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 9/46 (2006.01); G06F 9/50 (2006.01);
U.S. Cl.
CPC ...
G06F 9/5016 (2013.01); G06F 9/5033 (2013.01); G06F 9/5072 (2013.01);
Abstract

Techniques to improve memory utilization for performing a collective compute operation may include allocating an amount of space in a shared memory of a processing node that is part of an integrated circuit device having multiple processing nodes. A number of sharded portions of parameters are obtained and stored in the shared memory. Each of the sharded portions of parameters stored in the shared memory is multicasted to a state buffer of other processing nodes in the integrated circuit device to provide each state buffer with the number of sharded portions of parameters for the collective compute operation.


Find Patent Forward Citations

Loading…