Loading [MathJax]/extensions/MathZoom.js
STMA-GCN_PedCross: Skeleton Based Spatial-Temporal Graph Convolution Networks with Multiple Attentions for Fast Pedestrian Crossing Intention Prediction | IEEE Conference Publication | IEEE Xplore

STMA-GCN_PedCross: Skeleton Based Spatial-Temporal Graph Convolution Networks with Multiple Attentions for Fast Pedestrian Crossing Intention Prediction


Abstract:

Pedestrian crossing intention prediction is an important task for intelligent vehicles to enhance safety and reduce the risk of accidents. The high prediction accuracy an...Show More

Abstract:

Pedestrian crossing intention prediction is an important task for intelligent vehicles to enhance safety and reduce the risk of accidents. The high prediction accuracy and fast execution speed are essential requirements for this task. Existing studies on pedestrian crossing intention prediction have achieved good performance by using complex models and multiple modalities of input data. However, these approaches are limited in practical implications due to their high computational complexity and resource requirements. To address these, the paper propose the Spatial-Temporal Graph Convolution Network (GCN) with multiple attentions for fast and robust Pedestrian Crossing Intention Prediction (STMAGCN_PedCross). It utilizes easily accessible yet robust keypoints as input for predicting pedestrian crossing intention, making it both accurate and practical. To evaluate the effectiveness of the proposed model, we compared it with state-of-the-art models on a large-scale public Joint Attention in Autonomous Driving (JAAD) dataset. The results demonstrate that the STMA-GCN_PedCross model achieves comparable accuracy perfmance to the state-of-the-art models while having a higher robustness (recall rate) and requiring significantly less execution time. The ablation analysis further confirms the effectiveness of attention mechanisms in capturing spatial-temporal features from the skeleton sequence data by giving different attentions. Moreover, the analysis also reveals the significance of different keypoints in the prediction results.
Date of Conference: 24-28 September 2023
Date Added to IEEE Xplore: 13 February 2024
ISBN Information:

ISSN Information:

Conference Location: Bilbao, Spain

Funding Agency:


1. Introduction

Pedestrian safety is highly dependent on the safe operation of autonomous vehicles (AVs) on roads, making it a critical issue that requires special attention. The majority of autonomous vehicle accidents occur when the vehicle encounters pedestrians who are approaching to cross the road [1]. It highlights the importance of accurately predicting pedestrian crossing intention.

References

References is not available for this document.