Discriminant analysis based on modified generalised singular value decomposition and its numerical error analysis

IET Computer Vision

Volumn 3, Issue 3, 2009, Pages 159-173

  Wu, W ^a   Ahmad, M O ^a   Samadi, S ^a  

^a Gina Cody School of Engineering and Computer Science   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LOADS; DIRECT CALCULATION; EIGEN DECOMPOSITION; FEATURE SPACE; INNER PRODUCT; KERNEL PARAMETER; LINEAR ALGORITHMS; LINEAR DISCRIMINANT ANALYSIS; LINEAR INDEPENDENCE; MATRIX; NON-LINEAR; NUMERICAL ERRORS; OVERFITTING; SINGLE POINT; SINGULAR VECTORS; SMALL SAMPLE SIZE PROBLEMS; SMALL SIZE;

ALGORITHMS; DISCRIMINANT ANALYSIS; ERROR ANALYSIS; FACE RECOGNITION;

SINGULAR VALUE DECOMPOSITION;

EID: 69449094602     PISSN: 17519632     EISSN: 17519640     Source Type: Journal    
DOI: 10.1049/iet-cvi.2007.0076     Document Type: Article

References (36)

1. Jain, A.K., Duin, R.P.W., and Mao, J.: ' Statistical pattern recognition: A Review ', IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (1), p. 4-37 10.1109/34.824819 0162-8828 (Pubitemid 32132953)
2. Jolliffe, I.T.: ' Principle Component Analysis ', (Springer, New York, 1986)
3. Fukunagea, K.: ' Introduction to statistical pattern recognition ', 2nd (Academic Press, 1990)
4. Turk, M.A., and Pentland, A.P.: ' Eigenfaces for recognition ', J. Cogn. Neurosci., 1991, 3, (1), p. 71-86 0898-929X
5. Belhumeour, P.N., Hespanha, J.P., and Kriegman, D.J.: ' Eigenfaces versus Fisherfaces: Recognition using class specific linear projection ', IEEE Trans. Pattern Anal. Mach. Intell., 1997, 19, (7), p. 711-720 0162-8828
6. Liu, C., and Wechsler, H.: ' Enhanced Fisher linear discriminant models for face recognition ', Proc. Int. Conf. Pattern Recogn., 1998, IEEE
7. Yang, J., and Yang, J.Y.: ' Why can LDA be performed in PCA transformed space? ', Pattern Recogn., 2003, 36, p. 563-566
8. Friedman, J.H.: ' Regularized discriminant analysis ', J. Am. Stat. Assoc., 1989, 84, (405), p. 957-964 0162-1459
9. Dai, D.Q., and Yuen, P.C.: ' Regularized discriminant analysis and its Application to face recognition ', Pattern Recogn., 2003, 36, p. 845-847
10. Lu, J., Plataniotis, K.N., and Venetsanopoulos, A.N.: ' Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition ', Pattern Recogn. Lett., 2005, 26, p. 181-191 10.1016/j.patrec.2004.09.014
11. Lu, J., Plataniotis, K.N., and Venetsanopoulos, A.N.: ' Ensemble-based discriminant learning with boosting for face recognition ', IEEE, Trans. Neural Networks, 2006, 17, (1), p. 166-178 10.1109/TNN.2005.860853 1045-9227 (Pubitemid 43263949)
12. Ye, J., Xiong, T., and Li, Q.: et al. ' Efficient model selection for regularized linear discriminant analysis ', CIKM'06, November, 2006, p. 5-11
13. Taylor, J.S., and Cristianini, N.: ' Kernel methods for pattern analysis ', (Cambridge University Press, 2004)
14. Schölkopf, B., and Smola, A.J.: ' Learning with kernels - support vector machines, regularization, optimization, and beyond ', (MIT, Cambridge, MA, 2002)
15. Schölkopf, B., Smola, A., and Müller, K.R.: ' Nonlinear component analysis as a kernel eigenvalue problem ', Neural Comput., 1999, 10, p. 1299-1319 10.1162/089976698300017467 0899-7667
16. Baudat, G., and Fanouar, F.: ' Generalized discriminant analysis using a kernel approach ', Neural Comput., 2000, 12, p. 2385-2404 10.1162/ 089976600300014980 0899-7667
17. Lu, J., Plataniotis, K.N., and Venetsanopoulos, A.N.: ' Face recognition using kernel direct discriminant analysis algorithms ', IEEE Trans. Neural Networks, 2003, 14, (1), p. 117-126 10.1109/TNN.2002.806629 1045-9227
18. Yang, J., Frangi, A.F., Yang, J., Zhang, D., and Jin, Z.: ' KPCA plus LDA: a complete kernel fisher discriminant framework for feature extraction and recognition ', IEEE Trans. Pattern Anal. Mach. Intell., 2005, 27, (2), p. 230-244 0162-8828
19. Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N., and Wang, J.: ' An efficient kernel discriminant analysis method ', Pattern Recogn., 2005, 38, (10), p. 1788-1790 10.1016/j.patcog.2005.02.005 (Pubitemid 41037114)
20. Park, C.H., and Park, H.: ' Nonlinear discriminant analysis using kernel functions and the generalized singular value decomposition ', SIAM J. Matrix Analy. Appl., 2005, 27, (1), p. 87-102
21. Howland, P., Jeon, M., and Park, H.: ' Structure perserving dimension reduction for clustered text data based on the generalized singular value decomposition ', SIAM J. Matrix Anal. Appl., 2003, 25, (1), p. 165-179 10.1137/S0895479801393666 0895-4798
22. Ye, J., Janardan, R., Park, C.H., and Park, H.: ' An optimization criterion for generalized discriminant analysis on undersampled problems ', IEEE Trans. Pattern Anal. Mach. Intell., 2004, 26, (8), p. 982-994 0162-8828
23. Van Loan, C.F.: ' Generalizing the singular value decomposition ', SIAM J. Numerical Analy., 1976, 13, (1), p. 76-83
24. Paige, C.C., and Saunders, M.A.: ' Towards a Generalized Singular Value Decomposition ', SIAM J. Numerical Analy., 1981, 18, (3), p. 398-405
25. Park, C.H., and Park, H.: ' A comparision of generalized linear discriminant analysis algorithms ', Pattern Recogn., 2008, 41, p. 1083-1097
26. Wilkson, J.H.: ' The algebraic eigenvalue problem ', (Clarendon Press, Oxford, 1965)
27. Datta, B.N.: ' Numerical linear algebra and application ', (ITP, 1995)
28. Golub, G.H., and Van Loan, C.F.: ' Matrix computation ', 3rd (The Johns Hopkins University Press, 1996)
29. Strang, G.: ' Linear algebra and its application ', 3rd (MIT, 1998)
30. Ye, J., and Xiong, T.: ' Computational and theoretical analysis of null space and orthogonal linear discriminant analysis ', J. Mach. Learn. Res, 2006, 7, p. 1183-1204 1532-4435
31. Burges, C.: ' A tutorial on support vector machine for pattern recognition ', Data Mining and Knowledge Discovery, 1998, 2, p. 121-167 10.1023/A:1009715923555 (Pubitemid 128126769)
32. Image Group: Information Access Division, ITL, NIST, http://www.itl.nist. gov/iad/humanid/feret, January 2004
33. Martinez, A.M., Benavente, R.: 'The AR Face Database', CVC Technical Report 24, June 1998, http://rvl1.ecn.purdue.edu/~aleix/aleix-face-DB.html
34. 'Proc. Text Tetrieval Conf.', 1999, http://trec.nist.gov, TREC
35. Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: 'UCI Repository of machine learning databases': Department of Information and Computer Science, University of California, Irvine, CA, http://www.ics.uci.edu/~mlearn/ MLRepository.html.
36. Lewis, D.D.: 'Reuters-21578 text cagtegorization test collection distribution 1.0', http://www.research.att.com/lewis, 1999