Bound enhanced reinforcement learning system for distribution supply chain management

Abstract

Example implementations described herein involve systems and methods for bound enhanced reinforcement learning systems for distribution supply chain management which can include initializing a replay buffer, a first state-action value function network having first random weights, and a second state-action value function network having second random weights; determining an action corresponding to an inventory ordering quantity at one or more facility in a multi-echelon supply chain network based on an (epsilon) ϵ-greedy exploration policy; executing the action in a simulated environment, and storing transition results in the replay buffer; calculating an upper bound and a lower bound of the optimal inventory costs; incorporating the upper bound and the lower bound with at least hyper-parameters T, τin updating at least one of the first or the second state-action value function networks; and performing a gradient descent on the first state-action value function network based on the upper or the lower bound.