The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 09, 2021
Filed:
Dec. 30, 2015
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Jianfeng Gao, Woodinville, WA (US);
Li Deng, Redmond, WA (US);
Xiaodong He, Sammamish, WA (US);
Prabhdeep Singh, Newcastle, WA (US);
Lihong Li, Redmond, WA (US);
Jianshu Chen, Redmond, WA (US);
Xiujun Li, Tianjin, CN;
Ji He, Nanjing, CN;
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
A processing unit can operate a first recurrent computational model (RCM) to provide first state information and a predicted result value. The processing unit can operating a first network computational model (NCM) to provide respective expectation values of a plurality of actions based at least in part on the first state information. The processing unit can provide an indication of at least one of the plurality of actions, and receive a reference result value, e.g., via a communications interface. The processing unit can train the first RCM based at least in part on the predicted result value and the reference result value to provide a second RCM, and can train the first NCM based at least in part on the first state information and the at least one of the plurality of actions to provide a second NCM.