Abstract:
Recent developments of edge computing and content caching in wireless networks enable the Intelligent Transportation System (ITS) to provide high-quality services for veh...Show MoreMetadata
Abstract:
Recent developments of edge computing and content caching in wireless networks enable the Intelligent Transportation System (ITS) to provide high-quality services for vehicles. However, a variety of vehicular applications and time-varying network status make it challenging for ITS to allocate resources efficiently. Artificial intelligence algorithms, owning the cognitive capability for diverse and time-varying features of Internet of Connected Vehicles (IoCVs), enable an intent-based networking for ITS to tackle the above-mentioned challenges. In this paper, we develop an intent-based traffic control system by investigating Deep Reinforcement Learning (DRL) for 5G-envisioned IoCVs, which can dynamically orchestrate edge computing and content caching to improve the profits of Mobile Network Operator (MNO). By jointly analyzing MNO's revenue and users' quality of experience, we define a profit function to calculate the MNO's profits. After that, we formulate a joint optimization problem to maximize MNO's profits, and develop an intelligent traffic control scheme by investigating DRL, which can improve system profits of the MNO and allocate network resources effectively. Experimental results based on real traffic data demonstrate our designed system is efficient and well-performed.
Published in: IEEE Transactions on Intelligent Transportation Systems ( Volume: 22, Issue: 8, August 2021)
Funding Agency:
Citations are not available for this document.
Contents Cites in Papers - |
Cites in Papers - IEEE (102)
Select All
1.
Xiaojie Wang, Guifeng Zheng, Yu Wu, Qi Guo, Zhaolong Ning, "Distributed Edge Intelligence Empowered Hybrid Charging Scheduling in Internet of Electric Vehicles", IEEE Internet of Things Journal, vol.12, no.5, pp.4794-4806, 2025.
2.
Yuan Wang, Xiaona Lv, Xiaohu Gu, Dan Li, "A New Edge Computing Method Based on Deep Learning in Intelligent Transportation System", IEEE Transactions on Vehicular Technology, vol.74, no.2, pp.2210-2219, 2025.
3.
Yonghui Chen, Linglongyan, DaxiangAI, "An Robust Secure Blockchain-Based Hierarchical Asynchronous Federated Learning Scheme for Internet of Things", IEEE Access, vol.12, pp.165280-165297, 2024.
4.
Jingwei Geng, Zaiming Qin, Shunfu Jin, "Dynamic Resource Allocation for Cloud-Edge Collaboration Offloading in VEC Networks With Diverse Tasks", IEEE Transactions on Intelligent Transportation Systems, vol.25, no.12, pp.21235-21251, 2024.
5.
Jiwei Huang, Man Zhang, Jiangyuan Wan, Ying Chen, Ning Zhang, "Joint Data Caching and Computation Offloading in UAV-Assisted Internet of Vehicles via Federated Deep Reinforcement Learning", IEEE Transactions on Vehicular Technology, vol.73, no.11, pp.17644-17656, 2024.
6.
Abdelkader Mekrache, Adlen Ksentini, Christos Verikoukis, "Machine Learning in FCAPS: Toward Enhanced Beyond 5G Network Management", IEEE Communications Surveys & Tutorials, vol.26, no.4, pp.2769-2797, 2024.
7.
Hanshuai Cui, Zhiqing Tang, Jiong Lou, Weijia Jia, Wei Zhao, "Latency-Aware Container Scheduling in Edge Cluster Upgrades: A Deep Reinforcement Learning Approach", IEEE Transactions on Services Computing, vol.17, no.5, pp.2530-2543, 2024.
8.
Sahar Ebadinezhad, Kazeem Aminu Stanley, Glodie Mpia Engo, Nwabueze Kenneth Osemeha, Ahmad Shoaib Mayar, "The Impact of AI on Traffic Management and Safety in the Internet of Vehicles through Mobile Edge Computing", 2024 International Conference on Inventive Computation Technologies (ICICT), pp.319-326, 2024.
9.
Akanksha Goel, S. Neduncheliyan, "Health Monitoring and Diagnostic Platform Based on AI and IoMT Sensors: An Overview of Methodologies and Challenges", 2024 1st International Conference on Trends in Engineering Systems and Technologies (ICTEST), pp.1-5, 2024.
10.
Yongan Guo, Derui Ma, Hao She, Guan Gui, Chau Yuen, Hikmet Sari, Fumiyuki Adachi, "Deep Deterministic Policy Gradient-Based Intelligent Task Offloading for Vehicular Computing With Priority Experience Playback", IEEE Transactions on Vehicular Technology, vol.73, no.7, pp.10655-10667, 2024.
11.
Jiayuan Du, Guowei Zhang, Xiaowei Yuan, Xiaodong Zang, "P²SPA: Privacy Preservation Strategy With Pseudo-Addresses for Edge Computing Networks", IEEE Access, vol.12, pp.40962-40972, 2024.
12.
Jiawen Kang, Yue Zhong, Minrui Xu, Jiangtian Nie, Jinbo Wen, Hongyang Du, Dongdong Ye, Xumin Huang, Dusit Niyato, Shengli Xie, "Tiny Multiagent DRL for Twins Migration in UAV Metaverses: A Multileader Multifollower Stackelberg Game Approach", IEEE Internet of Things Journal, vol.11, no.12, pp.21021-21036, 2024.
13.
Ansh Sharma, Vaibhav Madan, Vishnu Bhargav, Nancy Gulati, "Smart City Traffic Control System: A Literature Review", 2024 14th International Conference on Cloud Computing, Data Science & Engineering (Confluence), pp.36-40, 2024.
14.
Huigang Chang, Yiming Liu, Zhengguo Sheng, "Distributed Multi-Agent Reinforcement Learning for Collaborative Path Planning and Scheduling in Blockchain-Based Cognitive Internet of Vehicles", IEEE Transactions on Vehicular Technology, vol.73, no.5, pp.6301-6317, 2024.
15.
Minseok Choi, Tiange Xiang, Joongheon Kim, "Intelligent Caching for Seamless High-Quality Streaming in Vehicular Networks: A Multi-Agent Reinforcement Learning Approach", IEEE Transactions on Intelligent Vehicles, vol.9, no.2, pp.3672-3686, 2024.
16.
Bach Long Nguyen, Duong D. Nguyen, Hung X. Nguyen, Duy T. Ngo, Markus Wagner, "Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach", IEEE Transactions on Emerging Topics in Computational Intelligence, vol.8, no.2, pp.1527-1539, 2024.
17.
Huixian Gu, Liqiang Zhao, Zhu Han, Gan Zheng, Shenghui Song, "AI-Enhanced Cloud-Edge-Terminal Collaborative Network: Survey, Applications, and Future Directions", IEEE Communications Surveys & Tutorials, vol.26, no.2, pp.1322-1385, 2024.
18.
Geng Chen, Yuxiang Zhou, Qingtian Zeng, Yu-Dong Zhang, "Research on Knowledge Graph-Aware Offloading Optimization and Content Acquisition Methods for Air-Ground Collaboration in VANETs", IEEE Transactions on Vehicular Technology, vol.73, no.3, pp.4309-4325, 2024.
19.
M. S. Mekala, Gaurav Dhiman, Ju H. Park, Ho-Youl Jung, Wattana Viriyasitavat, "ASXC^{2} Approach: A Service-X Cost Optimization Strategy Based on Edge Orchestration for IIoT", IEEE Transactions on Industrial Informatics, vol.20, no.3, pp.4347-4359, 2024.
20.
Xiangyu Gao, Yaping Sun, Hao Chen, Xiaodong Xu, Shuguang Cui, "Joint Computing, Pushing, and Caching Optimization for Mobile-Edge Computing Networks via Soft Actor–Critic Learning", IEEE Internet of Things Journal, vol.11, no.6, pp.9269-9281, 2024.
21.
Yuhuai Peng, Chenlu Wang, Wu Wen, Songye Wen, Xuanrui Xiong, "An Online Scheduling Framework for Multiple TBD Flows in Intelligent Transportation Systems", IEEE Transactions on Intelligent Transportation Systems, vol.25, no.1, pp.1054-1068, 2024.
22.
Zhikai Liu, Navneet Garg, Tharmalingam Ratnarajah, "Multi-Agent Federated Reinforcement Learning Strategy for Mobile Virtual Reality Delivery Networks", IEEE Transactions on Network Science and Engineering, vol.11, no.1, pp.100-114, 2024.
23.
Laisen Nie, Xiaojie Wang, Qinglin Zhao, Zhigang Shang, Li Feng, Guojun Li, "Digital Twin for Transportation Big Data: A Reinforcement Learning-Based Network Traffic Prediction Approach", IEEE Transactions on Intelligent Transportation Systems, vol.25, no.1, pp.896-906, 2024.
24.
Wang Chaowei, Wang Ziye, Xu Lexi, Yu Xiaofei, Zhang Zhi, Wang Weidong, "Collaborative Caching in Vehicular Edge Network Assisted by Cell-Free Massive MIMO", Chinese Journal of Electronics, vol.32, no.6, pp.1218-1229, 2023.
25.
Xiaojie Wang, Xin Wan, Zhaolong Ning, Zihan Qie, Jiameng Li, Yulong Xiao, "A Multimodal Fusion Depression Recognition Assisted Decision-Making System Based on EEG and Speech Signals", 2023 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI), pp.1-8, 2023.
26.
Guifeng Zheng, Qi Guo, Juan Xi, Shouze Tang, Ziyi Liu, Xuanrui Xiong, "A Novel Collaborative Representation Method for Hyperspectral Image Classification", 2023 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI), pp.1-6, 2023.
27.
Yixin Fan, Xuelian Cai, Wenwei Yue, Jing Zheng, Changle Li, "A Deep Reinforcement Learning Approach for Dependency-Aware Task Offloading in Cooperative Vehicular Networks", 2023 IEEE 34th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), pp.1-6, 2023.
28.
Yuexian Wang, Mohammad S. Obaidat, Yongtai Yin, Ling Wang, Joel J. P. C. Rodrigues, Balqies Sadoun, "Robust Sparse Direct Localization of Smart Vehicle With Partly Calibrated Time Modulated Arrays", IEEE Transactions on Intelligent Transportation Systems, vol.24, no.11, pp.12582-12596, 2023.
29.
K M Nafiul Hassan, Robson E. De Grande, "Zone-based Popularity-Oriented Multi-Layer Content Caching in Vehicular Fogs", 2023 19th International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT), pp.617-624, 2023.
30.
Taiyuan Gong, Li Zhu, F. Richard Yu, Tao Tang, "Edge Intelligence in Intelligent Transportation Systems: A Survey", IEEE Transactions on Intelligent Transportation Systems, vol.24, no.9, pp.8919-8944, 2023.
Cites in Papers - Other Publishers (97)
1.
Yonglin Leng, Peiyi Qu, Ying Guo, Chaoliang Xi, "PathBit: A Bit Index Based on Path for Large-Scale Knowledge Graph", Quality, Reliability, Security and Robustness in Heterogeneous Systems, vol.573, pp.181, 2024.
2.
Muhammad Ahmad Mudassir, Zafar Ullah, Shazia Kousar, Hammad Majeed, Fahid Nazir, Basharat Ali, Mohammad Amin Makarem, "Artificial Intelligence for Developing Smart and Sustainable Energy Systems", Reference Module in Earth Systems and Environmental Sciences, 2024.
3.
Runhao Zhou, Tobias Nousch, Lei Wei, Meng Wang, , 2024.
4.
Yunrui Bi, Qinglin Ding, Yijun Du, Di Liu, Shuaihang Ren, "Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning", Electronics, vol.13, no.19, pp.3894, 2024.
5.
Anushka Lydia Issac, "Digital Technologies in Smart Sustainable Cities: Focal Cases in the UAE", Digital Technologies to Implement the UN Sustainable Development Goals, pp.355, 2024.
6.
Liangtian Wan, Caiyun Wang, Lu Sun, Boyu Chen, Jibin Zheng, Xianpeng Wang, "Multi-objective Deployment of\\xa0WSNs in\\xa0Underground Sheltered Space", Quality, Reliability, Security and Robustness in Heterogeneous Systems, vol.573, pp.521, 2024.
7.
Hongjing Ji, Xiaojie Wang, Zhaolong Ning, "Joint User Scheduling and\\xa0UAV Height Control for\\xa0Smart Wearable Device Charging Network", Quality, Reliability, Security and Robustness in Heterogeneous Systems, vol.574, pp.422, 2024.
8.
ZhiDong Huang, XiaoFei Wu, ShouBin Dong, "Multi-objective task offloading for highly dynamic heterogeneous Vehicular Edge Computing: An efficient reinforcement learning approach", Computer Communications, 2024.
9.
Juliana Mas Kinanti Saragih, Putri Indah Sari, Adam Jamal, "Analisis Program Electronic Traffic Law Enforcement (E-TLE) pada Pengendalian Lalu Lintas di Kota Surabaya", Indonesian Journal of Public Administration Review, vol.1, no.2, pp.10, 2024.
10.
Ziyuan Gu, Yukai Wang, Wei Ma, Zhiyuan Liu, "A joint travel mode and departure time choice model in dynamic multimodal transportation networks based on deep reinforcement learning", Multimodal Transportation, vol.3, no.3, pp.100137, 2024.
11.
Mai Mohamed, Ahmed M. Ali, Mohamed Abdel-Basset, Mohamed Abouhawwash, S.S. Askar, Alshaimaa A. Tantawy, "Extension of simple multi-attribute rating technique in uncertainty environment for 5G industry evaluation: Egyptian new administrative capital as a case study", Heliyon, pp.e29033, 2024.
12.
Atefeh Hemmati, Mani Zarei, Amir Masoud Rahmani, "Big data challenges and opportunities in Internet of Vehicles: a systematic review", International Journal of Pervasive Computing and Communications, 2024.
13.
Akashdeep Kaur, Sharad Saxena, Rajesh Kumar, "OsCoMIT: Osmotic computing-based service management for intelligent transportation systems in 5G network", Cluster Computing, 2024.
14.
Zhaolong Ning, Hao Hu, Xiaojie Wang, Lei Guo, Song Guo, Guoyin Wang, Xinbo Gao, "Mobile Edge Computing and Machine Learning in the Internet of Unmanned Aerial Vehicles: A Survey", ACM Computing Surveys, vol.56, no.1, pp.1, 2024.
15.
Senthil Murugan Nagarajan, Ganesh Gopal Devarajan, Ramana T.V., Asha Jerlin M., Ali Kashif Bashir, Yasser D. Al-Otaibi, "Adversarial Deep Learning based Dampster?Shafer data fusion model for intelligent transportation system", Information Fusion, pp.102050, 2023.
16.
Guifeng Zheng, Xuanrui Xiong, Ying Li, Juan Xi, Tengfei Li, Amr Tolba, "Hyperspectral Image Classification Using Geodesic Spatial?Spectral Collaborative Representation", Electronics, vol.12, no.18, pp.3777, 2023.
17.
Yating Liu, Xiaojie Wang, Zhaolong Ning, MengChu Zhou, Lei Guo, Behrouz Jedari, "A survey on semantic communications: technologies, solutions, applications and challenges", Digital Communications and Networks, 2023.
18.
K. Rajkumar, B. Paramasivan, "Redundant node identification using Siamese neural network to enhance the availability in visual sensor network", International Journal of Communication Systems, 2023.
19.
Wu Wen, Tianhao Li, Amr Tolba, Ziyi Liu, Kai Shao, "Progressively Multi-Scale Feature Fusion for Image Inpainting", Mathematics, vol.11, no.24, pp.4908, 2023.
20.
Imtiyaz Khan, Syed Shabbeer Ahmad, Shaik Neeha, Asad Hussain Syed, Sayyada Mubeen, "A Deep Reinforcement Learning Framework for Task Scheduling for Leveraging Energy Efficiency in Cloud Computing", Proceedings of the Second International Conference on Emerging Trends in Engineering (ICETE 2023), vol.223, pp.484, 2023.
21.
Hoda Mashayekhi, Mostafa Nazari, Fatemeh Jafarinejad, Nader Meskin, "Deep Reinforcement Learning-based Control of Chemo-drug Dose in Cancer Treatment", Computer Methods and Programs in Biomedicine, pp.107884, 2023.
22.
Banavathu Rajarao, Meruva Sreenivasulu, "FD‐DBN: Flow directed deep belief network for accurate anomaly detection in cloud computing", International Journal of Communication Systems, vol.36, no.16, 2023.
23.
Xiaolan Tang, Yuting Liang, Guan Wang, Wenlong Chen, "Assisted driving system based on federated reinforcement learning", Displays, pp.102547, 2023.
24.
Miaoxin Xu, "A novel machine learning-based framework for channel bandwidth allocation and optimization in distributed computing environments", EURASIP Journal on Wireless Communications and Networking, vol.2023, no.1, 2023.
25.
Szilárd Kovács, Zoltán Barta, János Botzheim, "Traffic Optimization by Local Bacterial Memetic Algorithm", Computational Collective Intelligence, vol.14162, pp.484, 2023.
26.
Ernest Ntizikira, Wang Lei, Fahad Alblehai, Kiran Saleem, Muhammad Ali Lodhi, "Secure and Privacy-Preserving Intrusion Detection and Prevention in the Internet of Unmanned Aerial Vehicles", Sensors, vol.23, no.19, pp.8077, 2023.
27.
Bing Tang, Xiaoyuan Zhang, Qing Yang, Xin Qi, Fayez Alqahtani, Amr Tolba, "Cost‐optimized Internet of Things application deployment in edge computing environment", International Journal of Communication Systems, 2023.
28.
Ruiqi Ouyang, Xuanrui Xiong, Mingkai Fu, Jie Wang, Shixiong Chen, Osama Alfarraj, "A Scalable Video Multicast Scheme Based on User Demand Perception and D2D Communication", Sensors, vol.23, no.17, pp.7325, 2023.
29.
Hanxue Li, Shuaiqi Zhu, Amr Tolba, Ziyi Liu, Wu Wen, "A Reliable Delivery Logistics System Based on the Collaboration of UAVs and Vehicles", Sustainability, vol.15, no.17, pp.12720, 2023.
30.
Tengfei Li, Xuanrui Xiong, Guifeng Zheng, Ying Li, Amr Tolba, "A Blockchain-Based Shared Bus Service Scheduling and Management System", Sustainability, vol.15, no.16, pp.12516, 2023.
