The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 18, 2024
Filed:
Jun. 22, 2022
Amazon Technologies, Inc., Seattle, WA (US);
Praphruetpong Athiwaratkun, Jersey City, NJ (US);
Yuchen Tian, Santa Clara, CA (US);
Mingyue Shang, Jersey City, NJ (US);
Zijian Wang, San Jose, CA (US);
Ramesh M Nallapati, Fremont, CA (US);
Parminder Bhatia, Kearny, NJ (US);
Andrew Oliver Arnold, New York, NY (US);
Bing Xiang, Mount Kisco, NY (US);
Sudipta Sengupta, Sammamish, WA (US);
Yanitsa Donchev, Kirkland, WA (US);
Srinivas Iragavarapu, Redmond, WA (US);
Matthew Lee, Elmhurst, NY (US);
Vamshidhar Krishnamurthy Dantu, Sunnyvale, CA (US);
Atul Deo, Kirkland, WA (US);
Ankur Deepak Desai, Redmond, WA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.