The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 12, 2024
Filed:
Jun. 22, 2022
Amazon Technologies, Inc., Seattle, WA (US);
Praphruetpong Athiwaratkun, Jersey City, NJ (US);
Zixuan Lin, Seattle, WA (US);
Ramana Keerthi, Sammamish, WA (US);
Zijian Wang, San Jose, CA (US);
Yuchen Tian, Santa Clara, CA (US);
Hantian Ding, New York, NY (US);
Sri Ranga Akhilesh Bontala, Bothell, WA (US);
Matthew Lee, Elmhurst, NY (US);
Yanitsa Donchev, Kirkland, CA (US);
Ramesh M Nallapati, Fremont, CA (US);
Parminder Bhatia, Kearny, NJ (US);
Andrew Oliver Arnold, New York, NY (US);
Bing Xiang, Mount Kisco, NY (US);
Sudipta Sengupta, Sammamish, WA (US);
Rama Krishna Sandeep Pokkunuri, Redmond, WA (US);
Srinivas Iragavarapu, Redmond, WA (US);
Atul Deo, Kirkland, WA (US);
Ankur Deepak Desai, Redmond, WA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.