QoE Maximization for Video Streaming in Cache-Enable Satellite-UAV-Terrestrial Network

Unmanned aerial vehicle (UAV)-assisted video streaming is gaining growing interests in satellite-terrestrial networks due to the mobility and caching capability. However, it is challenging to perform trajectory planning and cache management towards maximizing quality of experience (QoE) for video streaming due to a dynamic network topology and a class of hybrid control actions. In this paper, we consider a QoE-oriented video streaming transport system in satellite-UAV-terrestrial network. Our goal is to design a transmission scheduling policy that can maximize the QoE received by the ground users (GUs) under the cache capacity constraints. In this regard, we formulate a scheduling problem as a cache-constrained Markov decision process (CMDP). To tackle the CMDP, we propose a novel hybrid reinforcement learning algorithm with risk sensibility. Extensive simulations show that our proposed scheme improves QoE by more than 50% over the conventionally configured schemes.