The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 6917925 B1

PDF
Full Text
Expired
Date of Patent:
Jul. 12, 2005

Filed:

Dec. 21, 2001
Applicants:

Hamid R. Berenji, Sunnyvale, CA (US);

David Vengrov, Sunnyvale, CA (US);

Inventors:

Hamid R. Berenji, Sunnyvale, CA (US);

David Vengrov, Sunnyvale, CA (US);

Assignee:
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06E001/00 ;
U.S. Cl.
CPC ...
Abstract

A system is controlled by an actor-critic based fuzzy reinforcement learning algorithm that provides instructions to a processor of the system for applying actor-critic based fuzzy reinforcement learning. The system includes a database of fuzzy-logic rules for mapping input data to output commands for modifying a system state, and a reinforcement learning algorithm for updating the fuzzy-logic rules database based on effects on the system state of the output commands mapped from the input data. The reinforcement learning algorithm is configured to converge at least one parameter of the system state to at least approximately an optimum value following multiple mapping and updating iterations. The reinforcement learning algorithm may be based on an update equation including a derivative with respect to at least one parameter of a logarithm of a probability function for taking a selected action when a selected state is encountered.


Find Patent Forward Citations

Loading…