Reinforcement learning exploration by exploiting past experiences for critical events

Abstract

A computer-implemented method is provided for reinforcement learning performed by a processor. The method includes obtaining, from an environment, a given experience that includes an action, a state and a reward. The method further includes storing the given experience in an experience buffer responsive to a value of the reward included in the given experience exceeding a first threshold. The method also includes responsive to obtaining another experience having another reward that less than or equal to the first threshold, searching the experience buffer for a candidate experience with a similar state to the other experience and copying the candidate experience into an event buffer. The method additionally includes during exploration, selecting an action to be taken to the environment from the event buffer with a predetermined probability.