The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 13, 2021

Filed:

Oct. 30, 2017
Applicant:

United Technologies Corporation, Farmington, CT (US);

Inventors:

Michael J. Giering, Bolton, CT (US);

Kishore K. Reddy, Vernon, CT (US);

Vivek Venugopalan, Bridgewater, NJ (US);

Amit Surana, West Hartford, CT (US);

Soumalya Sarkar, Manchester, CT (US);

Assignee:

RAYTHEON TECHNOLOGIES CORPORATION, Farmington, CT (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2006.01); G06N 20/00 (2019.01); G05B 13/02 (2006.01); G06N 3/04 (2006.01); G06N 5/02 (2006.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G05B 13/027 (2013.01); G05B 13/029 (2013.01); G06N 3/0454 (2013.01); G06N 5/022 (2013.01); G06N 20/00 (2019.01);
Abstract

Data indicative of a plurality of observations of an environment are received at a control system. Machine learning using deep reinforcement learning is applied to determine an action based on the observations. The deep reinforcement learning applies a convolutional neural network or a deep auto encoder to the observations and applies a training set to locate one or more regions having a higher reward. The action is applied to the environment. A reward token indicative of alignment between the action and a desired result is received. A policy parameter of the control system is updated based on the reward token. The updated policy parameter is applied to determine a subsequent action responsive to a subsequent observation.


Find Patent Forward Citations

Loading…