The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 14, 2021
Filed:
Jun. 14, 2018
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Marcos Campos, Carlsbad, CA (US);
Aditya Gudimella, Dublin, CA (US);
Ross Story, Berkeley, CA (US);
Matineh Shaker, Berkeley, CA (US);
Ruofan Kong, El Cerrito, CA (US);
Matthew Brown, Berkeley, CA (US);
Victor Shnayder, Berkeley, CA (US);
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
Methods and apparatuses that apply a hierarchical-decomposition reinforcement learning technique to train one or more AI objects as concept nodes composed in a hierarchical graph incorporated into an AI model. The individual sub-tasks of a decomposed task may correspond to its own concept node in the hierarchical graph and are initially trained on how to complete their individual sub-task and then trained on how the all of the individual sub-tasks need to interact with each other in the complex task in order to deliver an end solution to the complex task. Next, during the training, using reward functions focused for solving each individual sub-task and then a separate one or more reward functions focused for solving the end solution of the complex task. In addition, where reasonably possible, conducting the training of the AI objects corresponding to the individual sub-tasks in the complex task, in parallel at the same time.