Methods for edge cache replacement based on deep reinforcement learning

Abstract

A method for edge cache replacement based on deep reinforcement learning is provided, including: constructing a system network model; obtaining a caching state of an MEC server in the system network model; calculating a total delay for all users to obtain cached contents based on a total delay for a single user to obtain a cached content; constructing an optimization objective function based on the total delay for all users to obtain the cached contents; formulating a Markov decision process according to the optimization objective function; and replacing the cached content of the MEC server using a dynamic content replacement algorithm based on deep reinforcement learning according to the Markov decision process. According to a condition of a cache space of the MEC server, the system network model can obtain a minimum average delay for users to obtain contents and find a most suitable cache replacement policy.