The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Oct. 19, 2021
Filed:
May. 28, 2019
The Boeing Company, Chicago, IL (US);
Deepak Khosla, Camarillo, CA (US);
Kevin R. Martin, Oak Park, CA (US);
Sean Soleyman, Calabasas, CA (US);
Ignacio M. Soriano, University City, MO (US);
Michael A. Warren, Northridge, CA (US);
Joshua G. Fadaie, Saint Louis, MO (US);
Charles Tullock, Saint Peters, MO (US);
Yang Chen, Westlake Village, CA (US);
Shawn Moffit, Glen Carbon, IL (US);
Calvin Chung, Saint Louis, MO (US);
The Boeing Company, Chicago, IL (US);
Abstract
Apparatus and methods for training a machine learning algorithm (MLA) to control a first aircraft in an environment that comprises the first aircraft and a second aircraft are described. Training of the MLA can include: the MLA determining a first-aircraft action for the first aircraft to take within the environment; sending the first-aircraft action from the MLA; after sending the first-aircraft action, receiving an observation of the environment and a reward signal at the MLA, the observation including information about the environment after the first aircraft has taken the first-aircraft action and the second aircraft has taken a second-aircraft action, the reward signal indicating a score of performance of the first-aircraft action based on dynamic and kinematic properties of the second aircraft; and updating the MLA based on the observation of the environment and the reward signal.