Does complimentary information from multispectral imaging improve face presentation attack detection? | IEEE Conference Publication | IEEE Xplore

Does complimentary information from multispectral imaging improve face presentation attack detection?


Abstract:

Presentation Attack Detection (PAD) has been extensively studied, particularly in the visible spectrum. With the advancement of sensing technology beyond the visible rang...Show More

Abstract:

Presentation Attack Detection (PAD) has been extensively studied, particularly in the visible spectrum. With the advancement of sensing technology beyond the visible range, multispectral imaging has gained significant attention in this direction. We present PAD based on multispectral images constructed for eight different presentation artifacts resulted from three different artifact species. In this work, we introduce Face Presentation Attack Multispectral (FPAMS) database to demonstrate the significance of employing multispectral imaging. The goal of this work is to study complementary information that can be combined in two different ways (image fusion and score fusion) from multispectral imaging to improve the face PAD. The experimental evaluation results present an extensive qualitative analysis of 61650 sample multispectral images collected for bonafide and artifacts. The PAD based on the score fusion and image fusion method presents superior performance, demonstrating the significance of employing multispectral imaging to detect presentation artifacts.
Date of Conference: 22-24 January 2024
Date Added to IEEE Xplore: 19 March 2024
ISBN Information:
Conference Location: Goa, India
References is not available for this document.

I. Introduction

Over the past decades, the verification of users based on physiological biometric modalities has been the major reason for the popularity of biometrics for numerous applications [1]. Among the physiological biometric modalities, person verification using face is considered more convenient because of its ease of use and the non-intrusive nature of image acquisition. Despite impressive verification performance, and even outperforming human performance on most challenging datasets, face recognition systems still pose serious challenges when it comes to presentation attacks (PA) (i.e., spoofing attacks) [2]. A presentation attack is a deliberate attempt at impostor artifacts to impersonate the identity of genuine users by using Presentation Attack Instruments (PAIs) (according to the definitions of ISO/IEC 30107 standards [3]). With the widespread availability of facial images in the public domain, various PAIs are being created by attackers to obtain unauthorized access by presenting fake artifacts. The PAIs could be simple printed photographs or electronics display artifacts that constitute 2D presentation artifacts, while more sophisticated PAIs are 3D face mask artifacts presented in front of the Face Recognition System (FRS) to avail the access. Figure 1 illustrates the PAIs showing 2D and 3D presentation artifacts. The influence of PAIs such as 2D print, electronic display, and sophisticated 3D face masks has been studied in a substantial manner using state-of-the-art methods to demonstrate the vulnerability of facial biometrics against artifacts [4] [1], [5], [6]. Therefore, to mitigate vulnerability issues, several Presentation Attack Detection (PAD) algorithms based on handcrafted features and deep learning-based approaches have been proposed in the literature [1]. Although we note that the surveillance system operates in the visible spectrum, the majority of the face PADs employed are based on the visible spectrum [5]. On the other hand, artifacts are non-skin materials that leverage differential illumination properties compared to genuine skin across the electromagnetic spectrum because of which previous work has also shown preferences in working beyond the visible spectrum to alleviate the vulnerability of facial biometric systems [7]. More specifically, multispectral imaging has shown greater potential in this direction, thereby leveraging differential information in spatial and spectral domains. Considering these merits, in our work, we employed a multispectral imaging approach in nine narrow spectrum bands across the Visible (VIS) and Near-Infra-Red (NIR) wavelength ranges to detect presentation artifacts. Furthermore, generalizability towards unseen or unknown artifacts is a challenging task; hence, in this work, we present PAD by exploring the properties of multispectral imaging based on our newly introduced Face Presentation Attack Multispectral Database (FPAMS Database) for unseen or unknown artifacts in order to present the significance of our work. The major contributions of this work are summarized as follows: (1) Present face presentation attack detection explores the inherent properties of multispectral imaging in nine narrow bands across the VIS and NIR (530nm 1000nm) wavelength range. (2) Quantitative comparison of the image fusion (or early fusion) and score fusion (or late fusion) frameworks for face PAD. (3) Extensive experimental evaluation results are obtained on the newly introduced FPAMS database of 61650 samples, especially with the execution protocol of unseen attack detection, to confirm the performance of the proposed PAD framework.

Select All
1.
D. Sharma and A. Selwal, "A survey on face presentation attack detection mechanisms: hitherto and future perspectives", Multimedia Systems, vol. 29, pp. 1-51, 2023.
2.
A. George, Z. Mostaani, D. Geissenbuhler, O. Nikisins, A. Anjos and S. Marcel, "Biometric face presentation attack detection with multichannel convolutional neural network", IEEE Transactions on Information Forensics and Security, vol. 15, pp. 42-55, 2020.
3.
ISO/IEC DIS 30107-3. BiometricsPresentation Attack Detection - Part 3, August 2016.
4.
R. Raghavendra, K. B. Raja, S. Venkatesh and C. Busch, "Face presentation attack detection by exploring spectral signatures", 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 672-679, 2017.
5.
A. George, D. Geissbuhler and S. Marcel, A comprehensive evaluation on multi-channel biometric face presentation attack detection, 2022.
6.
S. Bhattacharjee, A. Mohammadi, A. Anjos and S. Marcel, Recent Advances in Face Presentation Attack Detection, Cham:Springer International Publishing, pp. 207-228, 2019.
7.
A. Costa-Pazo, IET Biometrics, vol. 10, no. 21, pp. 408-429, July 2021.
8.
N. Vetrekar, R. Raghavendra and R. Gad, "Low-cost multi-spectral face imaging for robust face recognition", 2016 IEEE International Conference on Imaging Systems and Techniques (IST), pp. 324-329, 2016.
9.
X. Zhu and D. Ramanan, "Face detection pose estimation and landmark localization in the wild", IEEE Conference on Computer Vision and Pattern Recognition, pp. 2879-2886, June 2012, [online] Available: https://www.ics.uci.edu/xzhu/face/.
10.
T. Ahonen, A. Hadid and M. Pietikainen, "Face description with local binary patterns: Application to face recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, 2006.
Contact IEEE to Subscribe

References

References is not available for this document.