CALP-FD: Cross Attention-Based Facial Landmarks Prompt for Face De-Morphing

Face morphing attacks have been demonstrated to present a significant risk to current Automatic Border Control systems. Despite research on morphing attack detection has made certain progress, the forensic analysis and restoration of accomplices’ facial images remain in the initial stage. Currently, face de-morphing methods based on deep learning technology usually ignore the role of facial landmarks, which are crucial to the structure of facial images. Therefore, the paper proposes CALP-FD, a novel method for face de-morphing using cross-attention-based facial landmarks prompt. By integrating facial landmarks, CALP-FD pays more attention to the features around the facial features and assigns greater weight to pixels around the landmarks. In addition, in order to effectively separate the identities of accomplices, CALP-FD applies cross-attention mechanism for representation interaction in the separation network to improve the restoration accuracy and image quality. In the experimental section, the paper conducts a comprehensive evaluation on HNU_FM, and the experimental results unequivocally demonstrate the superior restoration accuracy and robustness of our method compared to existing approaches.

I. Introduction

Facial recognition technology has become a key tool in Automatic Border Control (ABC) systems, helping to ensure the security and effective management of international borders. The application of this technology not only speeds up the customs clearance process, but also exerts a significant influence on border security and immigration control. However, as the application scope of facial recognition technology continues to expand, the security threats related to it are also increasing, including the serious harm to ABC caused by morphed facial images [1] - [5]. Examples of morphed images are depicted in Figure 1.