Loading [a11y]/accessibility-menu.js
CSR: A Lightweight Crowdsourced Road Structure Reconstruction System for Autonomous Driving | IEEE Conference Publication | IEEE Xplore

CSR: A Lightweight Crowdsourced Road Structure Reconstruction System for Autonomous Driving


Abstract:

Highly accurate and robust vectorized reconstruction of road structures is crucial for autonomous vehicles. Traditional LiDAR-based methods require multiple processes and...Show More

Abstract:

Highly accurate and robust vectorized reconstruction of road structures is crucial for autonomous vehicles. Traditional LiDAR-based methods require multiple processes and are often expensive, time-consuming, labor-intensive, and cumbersome. In this paper, we propose a lightweight crowdsourced road structure reconstruction system (termed CSR) that relies solely on online perceived semantic elements. Ambiguities and perceptual errors of semantic features and Global Navigation Satellite System (GNSS) global pose errors constitute the predominant challenge in achieving alignment across multi-trip data. To this end, a robust two-phased coarse-to-fine multi-trip alignment method is performed considering local geometric consistency, global topology consistency, intra-trip temporal consistency, and inter-trip consistency. Further, we introduce an incremental pose graph optimization framework with adaptive weight tuning ability to integrate pre-built road structures, currently perceived multi-trip semantic features, odometry, and GNSS, enabling accurate and robust incremental road structure reconstruction. CSR is highly automated, efficient, and scalable for large-scale autonomous driving scenarios, significantly expediting road structure production. We quantitatively and qualitatively validate the reconstruction performance of CSR in real-world scenes. CSR achieves centimeter-level accuracy commensurate with established LiDAR-based methods, concurrently boosting efficiency and reducing resource expenditure.
Date of Conference: 14-18 October 2024
Date Added to IEEE Xplore: 25 December 2024
ISBN Information:

ISSN Information:

Conference Location: Abu Dhabi, United Arab Emirates
References is not available for this document.

I. INTRODUCTION

Autonomous driving has attracted widespread attention with the increasing adoption of Advanced Driver Assistance Systems. A current trend is to abandon high-definition (HD) maps in favor of real-time online Bird’s Eye View (BEV) perception. However, this presents challenges at complex intersections, necessitating the reconstruction of road structures to provide prior information. Additionally, the reconstructed road structures can provide training labels for perception networks.

Select All
1.
S. Yang, X. Zhu, X. Nian, L. Feng, X. Qu and T. Ma, "A robust pose graph approach for city-scale lidar mapping", 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1175-1182, 2018.
2.
Y. Wang, Y. Lou, W. Song and Z. Tu, "A tightly-coupled framework for large-scale map construction with multiple non-repetitive scanning lidars", IEEE Sensors Journal, vol. 22, no. 4, pp. 3626-3636, 2022.
3.
T. Qin, Y. Zheng, T. Chen, Y. Chen and Q. Su, "A light-weight semantic map for visual localization towards autonomous driving", 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 11 248-11 254, 2021.
4.
T. Qin, H. Huang, Z. Wang, T. Chen and W. Ding, "Traffic flow-based crowdsourced mapping in complex urban scenario", IEEE Robotics and Automation Letters, vol. 8, no. 8, pp. 5077-5083, 2023.
5.
Y. Ma, T. Wang, X. Bai, H. Yang, Y. Hou, Y. Wang, et al., "Vision-centric bev perception: A survey", 2022.
6.
J. Philion and S. Fidler, "Lift splat shoot: Encoding images from arbitrary camera rigs by implicitly unprojecting to 3d", Computer Vision–ECCV 2020: 16th European Conference Glasgow UK August 23–28 2020 Proceedings Part XIV 16, pp. 194-210, 2020.
7.
Z. Li, W. Wang, H. Li, E. Xie, C. Sima, T. Lu, et al., "Bevformer: Learning bird’s-eye-view representation from multi-camera images via spatiotemporal transformers", European conference on computer vision, pp. 1-18, 2022.
8.
Z. Liu, H. Tang, A. Amini, X. Yang, H. Mao, D. L. Rus, et al., "Bevfusion: Multi-task multi-sensor fusion with unified bird’s-eye view representation", 2023 IEEE international conference on robotics and automation (ICRA), pp. 2774-2781, 2023.
9.
Q. Li, Y. Wang, Y. Wang and H. Zhao, "Hdmapnet: An online hd map construction and evaluation framework", 2022 International Conference on Robotics and Automation (ICRA), pp. 4628-4634, 2022.
10.
Y. Liu, T. Yuan, Y. Wang, Y. Wang and H. Zhao, "Vectormapnet: End-to-end vectorized hd map learning", International Conference on Machine Learning, pp. 22 352-22 369, 2023.
11.
L. Chen, C. Sima, Y. Li, Z. Zheng, J. Xu, X. Geng, H. Li, C. He, J. Shi, Y. Qiao et al., "Persformer: 3d lane detection via perspective transformer and the openlane benchmark", European Conference on Computer Vision, pp. 550-567, 2022.
12.
W. Ding, L. Qiao, X. Qiu and C. Zhang, "Pivotnet: Vectorized pivot learning for end-to-end hd map construction", Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3672-3682, 2023.
13.
T. Yuan, Y. Liu, Y. Wang, Y. Wang and H. Zhao, "Streammapnet: Streaming mapping network for vectorized online hd map construction", Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 7356-7365, 2024.
14.
B. Liao, S. Chen, X. Wang, T. Cheng, Q. Zhang, W. Liu, et al., "Maptr: Structured modeling and learning for online vectorized hd map construction", 2022.
15.
B. Liao, S. Chen, Y. Zhang, B. Jiang, Q. Zhang, W. Liu, et al., "Maptrv2: An end-to-end framework for online vectorized hd map construction", 2023.
16.
J. Zhang and S. Singh, "Loam: Lidar odometry and mapping in real-time" in Robotics: Science and systems, Berkeley, CA, vol. 2, no. 9, pp. 1-9, 2014.
17.
T. Shan and B. Englot, "Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain", 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4758-4765, 2018.
18.
T. Shan, B. Englot, D. Meyers, W. Wang, C. Ratti and D. Rus, "Lio-sam: Tightly-coupled lidar inertial odometry via smoothing and mapping", 2020 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp. 5135-5142, 2020.
19.
S. Chen, Y. Zhang, B. Liao, J. Xie, T. Cheng, W. Sui, et al., "Vma: Divide-and-conquer vectorized map annotation system for large-scale driving scene", 2023.
20.
K. Tang, X. Cao, Z. Cao, T. Zhou, E. Li, A. Liu, S. Zou, C. Liu, S. Mei, E. Sizikova et al., "Thma: Tencent hd map ai system for creating hd map annotations", Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 13, pp. 15 585-15 593, 2023.
21.
E. Rehder and A. Albrecht, "Submap-based slam for road markings", 2015 IEEE Intelligent Vehicles Symposium (IV), pp. 1393-1398, 2015.
22.
Z. Qiao, Z. Yu, H. Yin and S. Shen, "Online monocular lane mapping using catmull-rom spline", 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 7179-7186, 2023.
23.
T. Qin, T. Chen, Y. Chen and Q. Su, "Avp-slam: Semantic visual mapping and localization for autonomous vehicles in the parking lot", 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5939-5945, 2020.
24.
B. Wijaya, K. Jiang, M. Yang, T. Wen, X. Tang and D. Yang, "Crowdsourced road semantics mapping based on pixel-wise confidence level", Automotive Innovation, vol. 5, no. 1, pp. 43-56, 2022.
25.
M. Herb, T. Weiherer, N. Navab and F. Tombari, "Crowd-sourced semantic edge mapping for autonomous vehicles", 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 7047-7053, 2019.
26.
Z. Qin, H. Yu, C. Wang, Y. Guo, Y. Peng and K. Xu, "Geometric transformer for fast and robust point cloud registration", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 11 143-11 152, 2022.
27.
J. Lee, M. Cho and K. M. Lee, "Hyper-graph matching via reweighted random walks", CVPR 2011, pp. 1633-1640, 2011.
28.
H. Yang, P. Antonante, V. Tzoumas and L. Carlone, "Graduated non-convexity for robust spatial perception: From non-minimal solvers to global outlier rejection", IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 1127-1134, 2020.
29.
R. A. Rossi, D. F. Gleich and A. H. Gebremedhin, "Parallel maximum clique algorithms with applications to network analysis", SIAM Journal on Scientific Computing, vol. 37, no. 5, pp. C589-C616, 2015.
30.
K. Koide, J. Miura, M. Yokozuka, S. Oishi and A. Banno, "Interactive 3d graph slam for map correction", IEEE Robotics and Automation Letters, vol. 6, no. 1, pp. 40-47, 2020.

Contact IEEE to Subscribe

References

References is not available for this document.