The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 24, 2024
Filed:
May. 17, 2022
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Albert Ziegler, Uppsala, SE;
Oegerikus De Moor, Tas-Sliema, MT;
Balabhadra Graveley, San Francisco, CA (US);
Johan Sebastian Heesemann Rosenkilde, Birkerød, DK;
Edward Emil Aftandilian, Sunnyvale, CA (US);
Max Schaefer, Kidlington, GB;
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
A computer system identifies a code synthesis model and a set of software repositories, each comprising corresponding source code and corresponding tests for testing the corresponding source code. The computer system tests a plurality of generated source code predictions using the set of software repositories. The testing includes, for each software repository in the set of software repositories, identifying a portion of the corresponding source code of the software repository that is covered by the corresponding tests of the software repository, using the code synthesis model to generate a source code prediction for the portion of the corresponding source code, and using the corresponding tests of the software repository to test the source code prediction that was generated using the code synthesis model. Based on testing the plurality of generated source code predictions using the set of software repositories, the computer system generates an evaluation of the code synthesis model.