The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 20, 2026

Filed:

Dec. 16, 2022
Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Geoffrey Burr, Ossining, NY (US);

Shubham Jain, Elmsford, NY (US);

Yasuteru Kohda, Yamato, JP;

Milos Stanisavljevic, Langnau am Albis, CH;

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06F 17/16 (2006.01); G06N 3/063 (2023.01);
U.S. Cl.
CPC ...
G06F 17/16 (2013.01); G06N 3/063 (2013.01);
Abstract

Systems and methods for performing layer normalization are described. A circuit can receive a sequence of input data across a plurality of clock cycles, where the sequence of input data represents a portion of an input vector. The circuit can determine a plurality of sums and a plurality of sums of squares corresponding to the sequence of input data. The circuit can determine, based on the plurality of sums of squares, a first scalar representing an inverse square-root of a variance of vector elements in the input vector. The circuit can determine a second scalar representing a negation of a product of the first scalar and a mean of the vector elements in the input vector. The circuit can determine, based on the first scalar, the second scalar and the received sequence of input data, an output vector that is a normalization of the input vector.


Find Patent Forward Citations

Quick Actions:

Burr, Geoffrey. (2026). Hardware for parallel layer-norm compute (U.S. Patent No. 12769806). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12769806

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…