Wavelet Kernel Construction for Kernel Discriminant Analysis on Face Recognition | IEEE Conference Publication | IEEE Xplore

Wavelet Kernel Construction for Kernel Discriminant Analysis on Face Recognition


Abstract:

Kernel Discriminant Analysis (KDA) has been shown to be one of the promising approaches to handle the pose and illumination problem in face recognition. However, empirica...Show More

Abstract:

Kernel Discriminant Analysis (KDA) has been shown to be one of the promising approaches to handle the pose and illumination problem in face recognition. However, empirical results show that the performance for KDA on face recognition is sensitive to the kernel function and its parameters. Instead of following existing KDA methods in selecting popular kernel function, this paper proposes a new approach for constructing kernel using wavelet. By virtue of cubic B spline function, wavelet kernel function is constructed. A wavelet kernel based subspace linear discriminant (WKSLDA) algorithm is then developed for face recognition. Two human face databases, namely FERET and CMU PIE databases, are selected for evaluation. The results are encouraging. Comparing with the existing state-of-the-art RBF kernel based LDA methods, the proposed method gives superior resu
Date of Conference: 17-22 June 2006
Date Added to IEEE Xplore: 05 July 2006
Print ISBN:0-7695-2646-2

ISSN Information:

Conference Location: New York, NY, USA
References is not available for this document.

I. Introduction

Linear (Fisher) discriminant analysis-based (LDA) [1] method has been shown to be an effective approach in face recognition application and its superior performance has been reported in many literatures [3]–[14] in the last decade. LDA is theoretically sound and its objective is to find the most discriminant feature for classification. Hence, it is good for pattern recognition problem. However, LDA suffers from two major drawbacks. First, LDA is a linear method and is hard to solve nonlinear problem, while the second is the small sample size (S3) problem.

Select All
1.
P. N. Belhumeur, J. P. Hespanha and D. J. Kriegman, Eigenfaces vs. fisherfaces: Recognition using class specific linear projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp. 711-720, 1997.
2.
B. Schölkopf, A Smola and K Mller, Nonlinear component analysis as a kernel eigemalue problem, Neural Computation, Vol. 10, No.5, pp. 1299-1319, 1998.
3.
S. Mika, G. Rätsch, J. Weston, B. Schölkopf and K.-R. Müller, Fisher discriminant analysis with kernels, Y.-H Hu, J.Larsen, E.Wilson and S.Douglas, editors, Neural Networks for Signal Processing IX, IEEE, pp.41-48, 1999.
4.
S. Mika, G. Rätsch, J. Weston, B.Schölkopf, A. J. Smola and K.-R. Müller, Invariant feature extraction and classification in kernel spaces, S. A. Solla, T. K. Leen and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12, MIT Press, pp.526-532, 2000.
5.
G. Baudat and F. Anouar, Generalized discriminant analysis using a kernel approach, Neural Computation, Vol.12, No.10, pp.2385-2404, 2000.
6.
L. Chen, H. Liao, M. Ko, J. Lin, and G. Yu. A new LDA-based face recognition system, which can solve the small sample size problem, Pattern Recognition, Vol.33, No.10, pp.1713-1726, 2000.
7.
H. Yu and J. Yang, A direct LDA algorithm for high-dimensional data -with application to face recogniion, Pattern Recognition, Vol. 34, No. 10, pp.2067-2070, 2001.
8.
J. Lu, K. N. Plataniotis and A N Ventsanopoulos, Face recognition using kernel direct discriminant analysis algorithms, IEEE Trans. on Neural Network, Vol.14, No.1, pp.117-126, 2003.
9.
J. Huang, P. C. Yuen, W. S. Chen and J. H. Lai, Component-based subspacec linear discriminant analysis method for recognition of face images with one training sample, Optical Engineering, Vol.44, No.5, 2005.
10.
J Huang ,PC Yuen, WS Chen, JH Lai, Face Recognition Using Kernel Subspace LDA Algorithm, Proceeding of Asian Conference on Computer Vision (ACCV04), Vol.1, pp.61-66, 2004.
11.
W. S. Chen, P. C. Yuen, J. Huang and D. Q. Dai, Kernel machine-based one-parameter regularized Fisher discriminant method for face recognition, IEEE Transactions on Systems, Man and Cybernetics, Part B, Vol.35, No.4, pp.659-669, 2005.
12.
W. S. Chen, P. C. Yuen, J. Huang and J. H. Lai, Face Classification based on Shannon Wavelet Kernel and Modified Fisher Criterion, Proceeding of the 7th IEEE international conference on automatic face and gesture recognition(FG2006), Accepted to appear.
13.
J. Yang, A. F. Frangi, J. Y. Yang, D. Zhang and Z. Jin, KPCA plus LDA: a complete kernel Fisher Discriminant framework for feature extraction and recognition, IEEE Trans. Pattern Anal. Mach. Intell., Vol.27, No.2, pp.230-244, 2005.
14.
J. P. Ye, Q. Li, A Two-Stage Linear Discriminant Analysis via QR-Decomposition, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.27, No.6, pp.929 - 941, 2005.
15.
B. Schölkopf and A. J. Smola. Learning with kernels - support vector machines, regularisation, optimization and beyond, MIT Press, Cambridge, MA, 2002.
16.
J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge, 2004.
17.
S. Mallat, A theory for multiresolution signal decomposition: the wavelet representation, IEEE Pattern Anal. and Machine Intell, Vol.11, No.7, 1989, pp.674-693.
18.
Y. Meyer, Wavelets and operators, Cambridge Univ. Press, 1993.
19.
I. Daubechies, Ten lectures on wavelets, CBMS-NSF conference series in applied mathematics, SIAM Ed., 1992.
20.
J. H. Lai, P. C. Yuen and G. C. Feng, Face recognition using holistic Fourier invariant feature, Pattern Recognition, Vol.34, No.1, pp.95-109, 2001.

Contact IEEE to Subscribe

References

References is not available for this document.