The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 19, 2026
Filed:
Dec. 15, 2023
Amazon Technologies, Inc., Seattle, WA (US);
Subendhu Rongali, New York, NY (US);
Chandana Satya Prakash, Mountain View, CA (US);
Arpit Gupta, Emeryville, CA (US);
Wael Hamza, Wylie, TX (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Techniques for constraining a language model's generation/decoding process using a finite state machine are described. A finite state machine may represent information corresponding to APIs, arguments and argument values that are available/supported by the system. In some embodiments, a language model (LM) is constrained to generate tokens representing valid API calls based on the finite state machine. The system may enable generation of argument values from a defined set or free-form generation of argument values. The system may also enable unconstrained generation of a response by the LM. In some embodiments, a trie data structure is used to determine the possible next tokens that the LM can generate from.