The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 24, 2026
Filed:
Mar. 24, 2022
Amazon Technologies, Inc., Seattle, WA (US);
Hongbin Zheng, San Jose, CA (US);
Jie Wang, Sunnyvale, CA (US);
Sheng Xu, Santa Clara, CA (US);
Qingrui Liu, Burlingame, CA (US);
Pushkar Ratnalikar, San Jose, CA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
An optimization algorithm is disclosed to reduce the number of data shuffle operators in a data flow graph representing a neural network model for a neural network. The optimization algorithm can identify single-entry single-exit (SESE) regions in the data flow graph and select the SESE regions that comprise only the data shuffle operators. An affine map for each selected SESE region can be generated from an input of the selected SESE region to an output of the selected SESE region. An affine shuffle operator corresponding to an affine map for a selected SESE region can replace that SESE region if an implementation cost of the affine map is lower than the implementation cost of the SESE region. Thus, by replacing the selected SESE regions comprising multiple data shuffle operators with corresponding affine shuffle operators, it is possible to reduce the total number of operators in the data flow graph and optimize the neural network model.