The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 03, 2026

Filed:

Dec. 15, 2023
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Peng Tang, La Verne, CA (US);

Pengkai Zhu, Pasadena, CA (US);

Srikar Appalaraju, Martinez, CA (US);

Vijay Mahadevan, Los Angeles, CA (US);

Raghavan Manmatha, San Francisco, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/0455 (2023.01);
U.S. Cl.
CPC ...
G06N 3/0455 (2023.01);
Abstract

Just-in-time computation of decoder layer features is performed for an early exit decoder of a machine learning model. When generating an inference using an early exit decoder, decoder layer features that were not generated due to a prior early exit are identified. The identified decoder layer features are generated and then provided as input to a decoder layer feature during a decode step.


Find Patent Forward Citations

Quick Actions:

Tang, Peng. (2026). Just-in-time generation of decoder layer features for an early exit decoder (U.S. Patent No. 12783854). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12783854

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…