The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 31, 2020

Filed:

Jun. 29, 2017
Applicant:

Fanuc Corporation, Yamanashi, JP;

Inventors:

Shunichi Ozaki, Yamanashi, JP;

Hiroji Nishi, Yamanashi, JP;

Assignee:

FANUC CORPORATION, Yamanashi, JP;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
B25J 13/08 (2006.01); G06N 3/00 (2006.01); B25J 9/16 (2006.01); B25J 13/00 (2006.01); B25J 19/02 (2006.01); G06N 3/08 (2006.01); B25J 9/00 (2006.01); B25J 19/06 (2006.01);
U.S. Cl.
CPC ...
B25J 13/084 (2013.01); B25J 9/0084 (2013.01); B25J 9/163 (2013.01); B25J 9/1653 (2013.01); B25J 9/1676 (2013.01); B25J 9/1694 (2013.01); B25J 13/003 (2013.01); B25J 13/085 (2013.01); B25J 13/088 (2013.01); B25J 19/023 (2013.01); B25J 19/06 (2013.01); G06N 3/008 (2013.01); G06N 3/08 (2013.01); G06N 3/084 (2013.01); G05B 2219/40202 (2013.01); G05B 2219/40391 (2013.01); G05B 2219/40531 (2013.01);
Abstract

A machine learning device for learning a motion of a robot engaged in a task performed by a human and a robot in cooperation with each other, including a state observation unit that observes a state variable indicating a state of the robot when the human and the robot cooperate with each other and perform a task; a reward calculation unit that calculates a reward based on control data and the state variable for controlling the robot and on an action of the human; and a value function update unit that updates an action value function for controlling a motion of the robot, based on the reward and the state variable.


Find Patent Forward Citations

Loading…