Action information learning device, action information optimization system and computer readable medium

Abstract

To perform reinforcement learning that enables selecting action information for shortening a cycle time while also avoiding the occurrence of overheating. An action information learning device () includes: a state information acquisition means () for acquiring state information including an operation pattern of a spindle and a combination of parameters related to machining of a machine tool (); an action information output means () for outputting action information including adjustment information for the operation pattern and the combination of parameters included in the state information; a reward calculation means () for acquiring judgment information which is information for temperature of the machine tool () and a machining time related to the machining of the machine tool (), and calculating a value of a reward for reinforcement learning based on the judgment information thus acquired; and a value function update means () for updating a value function by performing the reinforcement learning based on the value of the reward, the state information and the action information.