Loading [MathJax]/extensions/MathMenu.js
Vehicle-Road-Cloud Collaborative Perception Framework and Key Technologies: A Review | IEEE Journals & Magazine | IEEE Xplore

Vehicle-Road-Cloud Collaborative Perception Framework and Key Technologies: A Review


Abstract:

Over recent years, the Vehicle-Road-Cloud Integration System (VRCIS) and Intelligent and Connected Vehicles (ICVs) have gained significant attention in the realm of auton...Show More

Abstract:

Over recent years, the Vehicle-Road-Cloud Integration System (VRCIS) and Intelligent and Connected Vehicles (ICVs) have gained significant attention in the realm of autonomous driving. By sharing data across diverse traffic participants and coordinating with VRCIS, ICVs can achieve enhanced perception accuracy and superior driving decisions, surpassing autonomous vehicles that rely solely on onboard sensors. Existing literature explores VRCIS’ overall architecture, applications, and deployment status. However, there is a lack of a comprehensive review focusing on the overarching architecture of ICV’s perception and its associated technologies, which are fundamental to VRCIS from an information integration perspective. This gap hinders the development of a robust perception framework for VRCIS, including the crucial perception technologies specific to it. This survey seeks to bridge this gap by offering an exhaustive review of the designed VRCIS perception framework and its specific perception technologies. Firstly, an overview of VRCIS’ perception architecture is provided, and the application relationships among various perception technologies are elucidated. Then, single-node, multi-node, and vehicle-road-cloud collaborative perception technologies are explored in sequence. Finally, the survey concludes with a discussion of insights and prospective future directions for VRCIS.
Published in: IEEE Transactions on Intelligent Transportation Systems ( Volume: 25, Issue: 12, December 2024)
Page(s): 19295 - 19318
Date of Publication: 30 September 2024

ISSN Information:

Funding Agency:

Author image of Bolin Gao
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Bolin Gao received the B.E. and M.E. degrees in vehicle engineering from Jilin University, Changchun, China, in 2007 and 2009, respectively, and the Ph.D. degree in vehicle engineering from Tongji University, Shanghai, China, in 2013. He is currently an Associate Research Professor with the School of Vehicle and Mobility, Tsinghua University. His research interests include the theoretical research and engineering applicat...Show More
Bolin Gao received the B.E. and M.E. degrees in vehicle engineering from Jilin University, Changchun, China, in 2007 and 2009, respectively, and the Ph.D. degree in vehicle engineering from Tongji University, Shanghai, China, in 2013. He is currently an Associate Research Professor with the School of Vehicle and Mobility, Tsinghua University. His research interests include the theoretical research and engineering applicat...View more
Author image of Jiaxi Liu
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Jiaxi Liu received the B.E. degree in mechanical engineering from the School of Vehicle and Mobility, Tsinghua University, where he is currently pursuing the M.E. degree in mechanical engineering with the School of Vehicle and Mobility. His research interests include collaborative perception, real-time perception, vehicle-road-cloud integration systems, and cyber-physical system architecture design.
Jiaxi Liu received the B.E. degree in mechanical engineering from the School of Vehicle and Mobility, Tsinghua University, where he is currently pursuing the M.E. degree in mechanical engineering with the School of Vehicle and Mobility. His research interests include collaborative perception, real-time perception, vehicle-road-cloud integration systems, and cyber-physical system architecture design.View more
Author image of Hengduo Zou
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Hengduo Zou is currently pursuing the B.E. degree in mechanical engineering with the School of Vehicle and Mobility, Tsinghua University. His research interests include autonomous driving, computer vision, and vehicle-road-cloud integration systems.
Hengduo Zou is currently pursuing the B.E. degree in mechanical engineering with the School of Vehicle and Mobility, Tsinghua University. His research interests include autonomous driving, computer vision, and vehicle-road-cloud integration systems.View more
Author image of Jiaxing Chen
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Jiaxing Chen received the M.S. degree in electrical and computer engineering from the University of Illinois, Chicago, USA, in 2021. He is currently pursuing the Ph.D. degree with the School of Vehicle and Mobility, Tsinghua University, Beijing, China. He was an Algorithm Engineer with the National Innovation Center of Intelligent and Connected Vehicles, Beijing, from 2021 to 2022. His research interests include computer ...Show More
Jiaxing Chen received the M.S. degree in electrical and computer engineering from the University of Illinois, Chicago, USA, in 2021. He is currently pursuing the Ph.D. degree with the School of Vehicle and Mobility, Tsinghua University, Beijing, China. He was an Algorithm Engineer with the National Innovation Center of Intelligent and Connected Vehicles, Beijing, from 2021 to 2022. His research interests include computer ...View more
Author image of Lei He
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Lei He received the B.S. degree from Beijing University of Aeronautics and Astronautics, China, in 2013, and the Ph.D. degree from the National Laboratory of Pattern Recognition, Chinese Academy of Sciences, in 2018. Since 2021, he has been a Post-Doctoral Fellow with the Department of Automation, Tsinghua University, Beijing, China. He was the Research Leader of autonomous driving algorithm with Baidu and NIO from 2018 t...Show More
Lei He received the B.S. degree from Beijing University of Aeronautics and Astronautics, China, in 2013, and the Ph.D. degree from the National Laboratory of Pattern Recognition, Chinese Academy of Sciences, in 2018. Since 2021, he has been a Post-Doctoral Fellow with the Department of Automation, Tsinghua University, Beijing, China. He was the Research Leader of autonomous driving algorithm with Baidu and NIO from 2018 t...View more
Author image of Keqiang Li
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Keqiang Li received the B.Tech. degree from the Tsinghua University of China, Beijing, China, in 1985, and the M.S. and Ph.D. degrees in mechanical engineering from Chongqing University of China, Chongqing, China, in 1988 and 1995, respectively. He is currently a Professor with the School of Vehicle and Mobility, Tsinghua University. His main research interests include automotive control systems, driver assistance systems...Show More
Keqiang Li received the B.Tech. degree from the Tsinghua University of China, Beijing, China, in 1985, and the M.S. and Ph.D. degrees in mechanical engineering from Chongqing University of China, Chongqing, China, in 1988 and 1995, respectively. He is currently a Professor with the School of Vehicle and Mobility, Tsinghua University. His main research interests include automotive control systems, driver assistance systems...View more

I. Introduction

Vehicles equipped predominantly with single-vehicle intelligence encounter numerous challenges in perception, decision-making, and control. For example, from the perception perspective, perception blind spots exist due to the limited field of view inherent in individual vehicles. Such limitations significantly impede the progression of autonomous driving from assisted stages to fully driverless stages. Vehicle-Road-Cloud Integration System (VRCIS) is considered to have the potential to promote autonomous driving to the advanced stage. VRCIS utilizes cutting-edge information and communication technologies to integrate the physical and cyber layers into a unified system, encompassing elements such as pedestrians, vehicles, roads, and the cloud. By facilitating unified perception, decision-making, and control, VRCIS aims to comprehensively enhance vehicle performance, traffic safety, and transportation system operational efficiency [1].

Author image of Bolin Gao
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Bolin Gao received the B.E. and M.E. degrees in vehicle engineering from Jilin University, Changchun, China, in 2007 and 2009, respectively, and the Ph.D. degree in vehicle engineering from Tongji University, Shanghai, China, in 2013. He is currently an Associate Research Professor with the School of Vehicle and Mobility, Tsinghua University. His research interests include the theoretical research and engineering application of the dynamic design and control of intelligent and connected vehicles, especially collaborative perception and tracking methods in cloud control systems, intelligent predictive cruise control systems on commercial trucks with cloud control mode, and the test and evaluation of intelligent vehicle driving systems.
Bolin Gao received the B.E. and M.E. degrees in vehicle engineering from Jilin University, Changchun, China, in 2007 and 2009, respectively, and the Ph.D. degree in vehicle engineering from Tongji University, Shanghai, China, in 2013. He is currently an Associate Research Professor with the School of Vehicle and Mobility, Tsinghua University. His research interests include the theoretical research and engineering application of the dynamic design and control of intelligent and connected vehicles, especially collaborative perception and tracking methods in cloud control systems, intelligent predictive cruise control systems on commercial trucks with cloud control mode, and the test and evaluation of intelligent vehicle driving systems.View more
Author image of Jiaxi Liu
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Jiaxi Liu received the B.E. degree in mechanical engineering from the School of Vehicle and Mobility, Tsinghua University, where he is currently pursuing the M.E. degree in mechanical engineering with the School of Vehicle and Mobility. His research interests include collaborative perception, real-time perception, vehicle-road-cloud integration systems, and cyber-physical system architecture design.
Jiaxi Liu received the B.E. degree in mechanical engineering from the School of Vehicle and Mobility, Tsinghua University, where he is currently pursuing the M.E. degree in mechanical engineering with the School of Vehicle and Mobility. His research interests include collaborative perception, real-time perception, vehicle-road-cloud integration systems, and cyber-physical system architecture design.View more
Author image of Hengduo Zou
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Hengduo Zou is currently pursuing the B.E. degree in mechanical engineering with the School of Vehicle and Mobility, Tsinghua University. His research interests include autonomous driving, computer vision, and vehicle-road-cloud integration systems.
Hengduo Zou is currently pursuing the B.E. degree in mechanical engineering with the School of Vehicle and Mobility, Tsinghua University. His research interests include autonomous driving, computer vision, and vehicle-road-cloud integration systems.View more
Author image of Jiaxing Chen
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Jiaxing Chen received the M.S. degree in electrical and computer engineering from the University of Illinois, Chicago, USA, in 2021. He is currently pursuing the Ph.D. degree with the School of Vehicle and Mobility, Tsinghua University, Beijing, China. He was an Algorithm Engineer with the National Innovation Center of Intelligent and Connected Vehicles, Beijing, from 2021 to 2022. His research interests include computer vision with deep learning and perception of intelligent and connected vehicles and transportation.
Jiaxing Chen received the M.S. degree in electrical and computer engineering from the University of Illinois, Chicago, USA, in 2021. He is currently pursuing the Ph.D. degree with the School of Vehicle and Mobility, Tsinghua University, Beijing, China. He was an Algorithm Engineer with the National Innovation Center of Intelligent and Connected Vehicles, Beijing, from 2021 to 2022. His research interests include computer vision with deep learning and perception of intelligent and connected vehicles and transportation.View more
Author image of Lei He
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Lei He received the B.S. degree from Beijing University of Aeronautics and Astronautics, China, in 2013, and the Ph.D. degree from the National Laboratory of Pattern Recognition, Chinese Academy of Sciences, in 2018. Since 2021, he has been a Post-Doctoral Fellow with the Department of Automation, Tsinghua University, Beijing, China. He was the Research Leader of autonomous driving algorithm with Baidu and NIO from 2018 to 2023. He is currently a Research Scientist in automotive engineering with Tsinghua University. His research interests include perception, SLAM, planning, and control.
Lei He received the B.S. degree from Beijing University of Aeronautics and Astronautics, China, in 2013, and the Ph.D. degree from the National Laboratory of Pattern Recognition, Chinese Academy of Sciences, in 2018. Since 2021, he has been a Post-Doctoral Fellow with the Department of Automation, Tsinghua University, Beijing, China. He was the Research Leader of autonomous driving algorithm with Baidu and NIO from 2018 to 2023. He is currently a Research Scientist in automotive engineering with Tsinghua University. His research interests include perception, SLAM, planning, and control.View more
Author image of Keqiang Li
State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, Beijing, China
Keqiang Li received the B.Tech. degree from the Tsinghua University of China, Beijing, China, in 1985, and the M.S. and Ph.D. degrees in mechanical engineering from Chongqing University of China, Chongqing, China, in 1988 and 1995, respectively. He is currently a Professor with the School of Vehicle and Mobility, Tsinghua University. His main research interests include automotive control systems, driver assistance systems, and networked dynamics and control. He is leading the national key project on intelligent and connected vehicles, China. He has authored more than 200 articles and is a co-inventor of more than 80 patents in China and Japan. He was a Fellow Member of the Society of Automotive Engineers of China, the Chairperson of Expert Committee of China Industrial Technology Innovation Strategic Alliance for ICVs (CAICV), and the CTO of China ICV Research Institute Company Ltd. (CICV). He served on the editorial boards for the International Journal of Vehicle Autonomous Systems. He was a recipient of Changjiang Scholar Program Professor and the National Award for Technological Invention in China.
Keqiang Li received the B.Tech. degree from the Tsinghua University of China, Beijing, China, in 1985, and the M.S. and Ph.D. degrees in mechanical engineering from Chongqing University of China, Chongqing, China, in 1988 and 1995, respectively. He is currently a Professor with the School of Vehicle and Mobility, Tsinghua University. His main research interests include automotive control systems, driver assistance systems, and networked dynamics and control. He is leading the national key project on intelligent and connected vehicles, China. He has authored more than 200 articles and is a co-inventor of more than 80 patents in China and Japan. He was a Fellow Member of the Society of Automotive Engineers of China, the Chairperson of Expert Committee of China Industrial Technology Innovation Strategic Alliance for ICVs (CAICV), and the CTO of China ICV Research Institute Company Ltd. (CICV). He served on the editorial boards for the International Journal of Vehicle Autonomous Systems. He was a recipient of Changjiang Scholar Program Professor and the National Award for Technological Invention in China.View more
Contact IEEE to Subscribe

References

References is not available for this document.