Abstract:
Space-air-ground integrated network (SAGIN) is a new type of wireless network mode. The effective management of SAGIN resources is a prerequisite for high-reliability com...Show MoreMetadata
Abstract:
Space-air-ground integrated network (SAGIN) is a new type of wireless network mode. The effective management of SAGIN resources is a prerequisite for high-reliability communication. However, the storage capacity of space-air network segment is extremely limited. The air servers also do not have sufficient storage resources to centrally accommodate the information uploaded by each edge server. So the problem of how to coordinate the storage resources of SAGIN has arisen. This paper proposes a SAGIN storage resource management algorithm based on distributed deep reinforcement learning (DRL). The resource management process is modeled as a Markov decision model. In each edge physical domain, we extract the network attributes represented by storage resources for the agent to build a training environment, so as to realize the distributed training. In addition, we propose a SAGIN resource management framework based on distributed DRL. Simulation results show that the agent has an ideal training effect. Compared with other algorithms, the resource allocation revenue and user request acceptance rate of the proposed algorithm are increased by about 18.15% and 8.35% respectively. Besides, the proposed algorithm has good flexibility in dealing with the changes of resource conditions.
Published in: IEEE Journal of Selected Topics in Signal Processing ( Volume: 16, Issue: 3, April 2022)
Funding Agency:
Citations are not available for this document.
Contents Cites in Papers - |
Cites in Papers - IEEE (29)
Select All
1.
Lingyi Wang, Wei Wu, Fuhui Zhou, Zhijin Qin, Qihui Wu, "IRS-Enhanced Secure Semantic Communication Networks: Cross-Layer and Context-Awared Resource Allocation", IEEE Transactions on Wireless Communications, vol.24, no.1, pp.494-508, 2025.
2.
Chao Wang, Xiao Ma, Ruolin Xing, Sisi Li, Ao Zhou, Shangguang Wang, "Delay- and Resource-Aware Satellite UPF Service Optimization", IEEE Transactions on Mobile Computing, vol.24, no.4, pp.2564-2579, 2025.
3.
Jinshan Chen, Shiyu Wu, Xinlan Wang, Sihang Yu, Chaoping Deng, Guodong Lin, Zhaoxiang Li, "Research on Low Power Strategy Optimization and Environmental Adaptability of 5G RedCap Terminal for Electric Power Application", 2024 IEEE 5th International Conference on Advanced Electrical and Energy Systems (AEES), pp.314-318, 2024.
4.
Zheyi Chen, Junjie Zhang, Geyong Min, Zhaolong Ning, Jie Li, "Traffic-Aware Lightweight Hierarchical Offloading Toward Adaptive Slicing-Enabled SAGIN", IEEE Journal on Selected Areas in Communications, vol.42, no.12, pp.3536-3550, 2024.
5.
Yuxi Lu, Chunxiao Jiang, Lizhuang Tan, Jianyong Zhang, Peiying Zhang, Chunming Rong, "UAV Dynamic Service Function Chains Deployment Based on Security Considerations: A Reinforcement Learning Method", IEEE Internet of Things Journal, vol.11, no.24, pp.39731-39743, 2024.
6.
Ranshu Peng, Shi Chen, Changbin Xue, "Collaborative Content Caching Algorithm for Large-Scale ISTNs Based on MAPPO", IEEE Wireless Communications Letters, vol.13, no.11, pp.3069-3073, 2024.
7.
Peiying Zhang, Zhiqiang Li, Mohsen Guizani, Neeraj Kumar, Keping Yu, Jian Wang, "Energy Aware Space-Air-Ground Integrated Network Resource Orchestration Algorithm", IEEE Transactions on Vehicular Technology, vol.73, no.12, pp.18950-18960, 2024.
8.
Joydeep Kundu, Sahabul Alam, Jadav Chandra Das, Arindam Dey, Debashis de, "Trust-Based Flying Ad Hoc Network: A Survey", IEEE Access, vol.12, pp.99258-99281, 2024.
9.
Wensheng Su, Zhenni Li, Minrui Xu, Jiawen Kang, Dusit Niyato, Shengli Xie, "Compressing Deep Reinforcement Learning Networks With a Dynamic Structured Pruning Method for Autonomous Driving", IEEE Transactions on Vehicular Technology, vol.73, no.12, pp.18017-18030, 2024.
10.
Hongyang Du, Ruichen Zhang, Yinqiu Liu, Jiacheng Wang, Yijing Lin, Zonghang Li, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shuguang Cui, Bo Ai, Haibo Zhou, Dong In Kim, "Enhancing Deep Reinforcement Learning: A Tutorial on Generative Diffusion Models in Network Optimization", IEEE Communications Surveys & Tutorials, vol.26, no.4, pp.2611-2646, 2024.
11.
Deyang Sun, Hang Li, Zixuan Kong, Zhenghe Zhu, Yawen Chen, Zhaoming Lu, Xiangming Wen, "Multicast SFC Embedding in Software-Defined SAGIN with Heterogeneous Network Resources", 2024 IEEE Wireless Communications and Networking Conference (WCNC), pp.1-6, 2024.
12.
Fan Zhou, Lin Wang, Meng Ning, Yuxin Zhu, Yang Wang, Binghe Tian, Peiying Zhang, Jianyong Zhang, Shaoqiang Wang, "An Information Transmission Method of Data-Driven Frequency Hopping OFDM for IoV", IEEE Internet of Things Journal, vol.11, no.22, pp.35852-35863, 2024.
13.
Xiangjie Meng, Heyu Li, Wei Han, "Multi-Band and Multi-Network Cooperative Transmission Algorithm for Wireless Resource Optimization", IEEE Access, vol.12, pp.31916-31929, 2024.
14.
Sheng Wu, Ning Chen, Ailing Xiao, Haoge Jia, Chunxiao Jiang, Peiying Zhang, "AI-Enabled Deployment Automation for 6G Space-Air-Ground Integrated Networks: Challenges, Design, and Outlook", IEEE Network, vol.38, no.6, pp.219-226, 2024.
15.
Min Jia, Jian Wu, Qing Guo, Yang Yang, "Service-Oriented SAGIN With Pervasive Intelligence for Resource-Constrained Users", IEEE Network, vol.38, no.2, pp.79-86, 2024.
16.
Peiying Zhang, Ning Chen, Guanjun Xu, Neeraj Kumar, Ahmed Barnawi, Mohsen Guizani, Youxiang Duan, Keping Yu, "Multi-Target-Aware Dynamic Resource Scheduling for Cloud-Fog-Edge Multi-Tier Computing Network", IEEE Transactions on Intelligent Transportation Systems, vol.25, no.5, pp.3885-3897, 2024.
17.
Ziqi Li, Heli Zhang, Chunyu Liu, Xi Li, Hong Ji, Victor C. M. Leung, "Online Service Deployment on Mega-LEO Satellite Constellations for End-to-End Delay Optimization", IEEE Transactions on Network Science and Engineering, vol.11, no.1, pp.1214-1226, 2024.
18.
Yi Zhang, Chunxiao Jiang, Peiying Zhang, "Security-Aware Resource Allocation Scheme Based on DRL in Cloud–Edge–Terminal Cooperative Vehicular Network", IEEE Internet of Things Journal, vol.11, no.1, pp.95-104, 2024.
19.
Peiying Zhang, Yi Zhang, Neeraj Kumar, Mohsen Guizani, Ahmed Barnawi, Wei Zhang, "Energy-Aware Positioning Service Provisioning for Cloud-Edge-Vehicle Collaborative Network Based on DRL and Service Function Chain", IEEE Transactions on Mobile Computing, vol.23, no.4, pp.3424-3435, 2024.
20.
Peiying Zhang, Ning Chen, Shigen Shen, Shui Yu, Neeraj Kumar, Ching-Hsien Hsu, "AI-Enabled Space-Air-Ground Integrated Networks: Management and Optimization", IEEE Network, vol.38, no.2, pp.186-192, 2024.
21.
Ran Zhao, Jiaming Mao, Jinghang Yu, Lei Fan, "Smart Grid Resource Scheduling Algorithm Based on Reinforcement Learning for Edge Computing", 2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS), pp.1015-1018, 2023.
22.
Weihao Yan, Jianping An, Jinpeng Song, Yixuan Li, Shuai Wang, "Multicarrier Spread Spectrum for Mega-Constellation Satellite Networks: Challenges, Opportunities, and Future Trends", IEEE Internet of Things Journal, vol.10, no.23, pp.20358-20367, 2023.
23.
Antonio Petrosino, Giuseppe Piro, Luigi Alfredo Grieco, Gennaro Boggia, "On the Optimal Deployment of Virtual Network Functions in Non-Terrestrial Segments", IEEE Transactions on Network and Service Management, vol.20, no.4, pp.4831-4845, 2023.
24.
Di Zhou, Min Sheng, Jiandong Li, Zhu Han, "Aerospace Integrated Networks Innovation for Empowering 6G: A Survey and Future Challenges", IEEE Communications Surveys & Tutorials, vol.25, no.2, pp.975-1019, 2023.
25.
Wei Liu, Huiting Yang, Jiandong Li, "Multi-Functional Time Expanded Graph: A Unified Graph Model for Communication, Storage, and Computation for Dynamic Networks Over Time", IEEE Journal on Selected Areas in Communications, vol.41, no.2, pp.418-431, 2023.
26.
Minghui Dai, Ning Huang, Yuan Wu, Jie Gao, Zhou Su, "Unmanned-Aerial-Vehicle-Assisted Wireless Networks: Advancements, Challenges, and Solutions", IEEE Internet of Things Journal, vol.10, no.5, pp.4117-4147, 2023.
27.
Peiying Zhang, Yi Zhang, Neeraj Kumar, Mohsen Guizani, "Dynamic SFC Embedding Algorithm Assisted by Federated Learning in Space–Air–Ground-Integrated Network Resource Allocation Scenario", IEEE Internet of Things Journal, vol.10, no.11, pp.9308-9318, 2023.
28.
Zihan Chen, Shushi Gu, Qinyu Zhang, Ning Zhang, Wei Xiang, "Energy-Efficient Coded Content Placement for Satellite-Terrestrial Cooperative Caching Network", 2022 14th International Conference on Wireless Communications and Signal Processing (WCSP), pp.871-876, 2022.
29.
Peiying Zhang, Yu Su, Jingjing Wang, Chunxiao Jiang, Ching-Hsien Hsu, Shigen Shen, "Reinforcement Learning Assisted Bandwidth Aware Virtual Network Resource Allocation", IEEE Transactions on Network and Service Management, vol.19, no.4, pp.4111-4123, 2022.
Cites in Papers - Other Publishers (5)
1.
Wei Wang, Shengpeng Chen, Peiying Zhang, Kai Liu, "Reinforcement-Learning-Assisted Service Function Chain Embedding Algorithm in Edge Computing Networks", Electronics, vol.13, no.15, pp.3007, 2024.
2.
Hui Song, Chen Liu, Ali Moradi Amani, Mingchen Gu, Mahdi Jalili, Lasantha Meegahapola, Xinghuo Yu, George Dickeson, "Smart optimization in battery energy storage systems: An overview", Energy and AI, pp.100378, 2024.
3.
Yuxi Lu, Wu Wen, Kostromitin Konstantin Igorevich, Peng Ren, Hongxia Zhang, Youxiang Duan, Hailong Zhu, Peiying Zhang, "UAV Ad Hoc Network Routing Algorithms in Space?Air?Ground Integrated Networks: Challenges and Directions", Drones, vol.7, no.7, pp.448, 2023.
4.
Sana Sharif, Sherali Zeadally, Waleed Ejaz, "Space-aerial-ground-sea integrated networks: Resource optimization and challenges in 6G", Journal of Network and Computer Applications, pp.103647, 2023.
5.
Keqiang Zhan, Ning Chen, Sripathi Venkata Naga Santhosh Kumar, Godfrey Kibalya, Peiying Zhang, Hongxia Zhang, "Edge computing network resource allocation based on virtual network embedding", International Journal of Communication Systems, 2022.
