The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 18, 2020

Filed:

Jun. 04, 2018
Applicant:

Fanuc Corporation, Yamanashi, JP;

Inventors:

Satoshi Ikai, Yamanashi, JP;

Tsutomu Nakamura, Yamanashi, JP;

Tomoyuki Aizawa, Yamanashi, JP;

Assignee:

FANUC CORPORATION, Yamanashi, JP;

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G05B 19/404 (2006.01); G06N 3/08 (2006.01); G06N 3/04 (2006.01); G05B 13/02 (2006.01); B23Q 15/12 (2006.01); G06N 3/00 (2006.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G05B 19/404 (2013.01); B23Q 15/12 (2013.01); G05B 13/0245 (2013.01); G05B 13/0265 (2013.01); G06N 3/006 (2013.01); G06N 3/0454 (2013.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01); G05B 2219/41032 (2013.01); G05B 2219/41054 (2013.01); G05B 2219/41078 (2013.01); G05B 2219/41386 (2013.01);
Abstract

To perform reinforcement learning enabling to prevent complicated adjustment of coefficients of backlash compensation and backlash acceleration compensation. A machine learning apparatus includes a state information acquiring part for acquiring, from a servo control apparatus, state information including at least position deviation and a set of coefficients to be used by a backlash acceleration compensating part, by making the servo control apparatus execute a predetermined machining program, an action information output part for outputting action information including adjustment information on the set of coefficients included in the state information to the servo control apparatus, a reward output part for outputting a reward value in the reinforcement learning on the basis of the position deviation included in the state information, and a value function updating part for updating an action-value function on the basis of the reward value output by the reward output part, the state information and the action information.


Find Patent Forward Citations

Loading…