The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 18, 2021
Filed:
May. 10, 2018
Fanuc Corporation, Yamanashi, JP;
Shougo Shinoda, Yamanashi, JP;
Satoshi Ikai, Yamanashi, JP;
FANUC CORPORATION, Yamanshi, JP;
Abstract
A machine learning device that performs reinforcement learning with respect to a servo control apparatus that controls target device having a motor, including: outputting action information including adjustment information of coefficients of a transfer function of a controller gain to a controller included in the servo control apparatus; acquiring, from the servo control apparatus, state information including a deviation between an actual operation of the target device and a command input to the controller, a phase of the motor, and the coefficients of the transfer function of the controller gain when the controller operates the target device based on the action information; outputting a value of a reward in the reinforcement learning based on the deviation included in the state information; and updating an action-value function based on the value of the reward, the state information, and the action information.