Multiobjective Deep Reinforcement Learning Assisted Resource Allocation for MEC-Caching-Coexist System

In order to overcome the vicious competition between different high-volume services, we study the wireless resource sharing problem in the transmission process of the MEC-caching-coexist (MCCe) system with the capability of mmWave communications. The multiobjective Markov decision process (MOMDP) is introduced to model the task scheduling and resource allocation problem for the mmWave links, which aims to minimize the transmission delay and energy consumption simultaneously. Note that, for practical consideration, the exact channel information of all links are not known. We propose a novel multiobjective deep reinforcement learning with discrete-continuous hybrid action space (MODRL/HA) algorithm. In particular, the envelope updated design (EUD) is designed to realize the multiobjective optimization from the perspective of the Bellman operator. On the other hand, the parameterized network design (PND) is developed to deal with the hybrid action space of discrete task scheduling and continuous beamwidth and power variables. Our simulations show that, the MODRL/HA algorithm can improve 22% performance in terms of the tradeoff between delay and energy consumption compared with the benchmark schemes, which are original deep deterministic policy gradient (DDPG) and multiobjective DDPG (MODDPG) algorithms.