The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 27, 2025

Filed:

Apr. 24, 2023
Applicant:

Microsoft Technology Licensing, Llc., Redmond, WA (US);

Inventors:

Nan Duan, Beijing, CN;

Shengyu Fu, Redmond, WA (US);

Shuai Lu, Beijing, CN;

Neelakantan Sundaresan, Bellevue, WA (US);

Alexey Svyatkovskiy, Bellevue, WA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 11/362 (2025.01); G06N 3/08 (2023.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G06F 11/3636 (2013.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01);
Abstract

A large language model, previously pre-trained on multiple source code modeling tasks, is pre-trained, through curriculum learning, to learn to predict a code execution trace given a source code program. The model is pre-trained using a variety of pre-training datasets consisting of pairs of a source code sample and a corresponding execution trace. The curriculum pre-training starts with a pre-training dataset of single line executions and adds in additional pre-training datasets with more increasing complex behaviors. The pre-training datasets include mutation-augmented source code samples and their corresponding execution traces.


Find Patent Forward Citations

Loading…