The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 13, 2015

Filed:

Sep. 21, 2011
Applicant:

Filip Ponulak, San Diego, CA (US);

Inventor:

Filip Ponulak, San Diego, CA (US);

Assignee:

Brain Corporation, San Diego, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06F 15/18 (2006.01); B25J 9/16 (2006.01); G05B 13/02 (2006.01); G06N 99/00 (2010.01);
U.S. Cl.
CPC ...
B25J 9/1635 (2013.01); G05B 13/0265 (2013.01); G06N 99/005 (2013.01);
Abstract

A control apparatus and methods using context-dependent difference learning for controlling e.g., a plant. In one embodiment, the apparatus includes an actor module and a critic module. The actor module provides a control signal for the plant. The actor module is subject to adaptation, which is performed to optimize control strategy of the actor. The adaptation is based upon the reinforcement signal provided by the critic module. The reinforcement signal is calculated based on the comparison of a present control performance signal observed for a certain context signal, with a control performance signal observed for the same context in the past.


Find Patent Forward Citations

Loading…