AI-Enabled Space-Air-Ground Integrated Networks: Management and Optimization

AI-enabled Beyond 5G (B5G) and 6G technologies are promising candidates to support the future generation Space-Air-Ground Integrated Networks (SAGINs). The highly dynamic heterogeneity and time variability, however, complicate management and optimization efforts. Hence, based on the software-defined networking (SDN) technology, in the proposed hierarchical hybrid deep reinforcement learning (HHDRL) method, we demonstrate how one can combine both distributed and central architectures, by deploying local controllers in different domains and global controllers on the whole. It permits us to optimize the network through local fine control and global macro control. We also deploy the DRL models in the controllers, where the optimal policy is learned through the effective interactions between the agent and the environment, as well as via the feedback of the incentive mechanism. Finally, a case study based on resource allocation and related analysis illustrates in detail that the AI algorithm represented by HHDRL will significantly promote the management and optimization process of SAGIN.

Introduction

Emerging communication technologies such as beyond 5G (B5G) and 6G are committed to achieving high-speed, low-latency, and high-density, as well as providing seamless coverage. For example, the peak download speed of 6G is predicted to reach 1 Tbit/s, with the transmission delay reduced to 1 ms or even 0.1 ms, and the device density is likely to reach 100/ [1]. In addition, its wavelength will be reduced to mm, which will expand the signal frequency from the millimeter waveband of 5G to the terahertz waveband. Furthermore, the indoor and outdoor positioning accuracy will be accurate to 10 cm and , respectively. In general, all aspects of B5G and 6G indicators will be improved by 10 to 100 times based on 5G [2]. At that time, due to its excellent performance, it is expected to achieve seamless coverage of more than 99% of the world’s terrestrial and ocean through ground base stations, maritime communications, drones, satellites, etc.