Nonlinear discriminant analysis using kernel functions and the generalized singular value decomposition

SIAM Journal on Matrix Analysis and Applications

Volumn 27, Issue 1, 2006, Pages 87-102

  Park, Cheong Hee ^a   Park, Haesun ^b,c  

^a Chungnam National University   (South Korea)

^b University of Minnesota   (United States)

^c NATIONAL SCIENCE FOUNDATION   (United States)

Author keywords

Dimension reduction; Generalized singular value decomposition; Kernel functions; Linear discriminant analysis; Nonlinear discriminant analysis

Indexed keywords

DIMENSION REDUCTION; GENERALIZED SINGULAR VALUE DECOMPOSITION; KERNEL FUNCTIONS; LINEAR DISCRIMINANT ANALYSIS; NONLINEAR DISCRIMINANT ANALYSIS;

DIMENSIONAL STABILITY; EIGENVALUES AND EIGENFUNCTIONS; MATRIX ALGEBRA; PROBLEM SOLVING; VALUE ENGINEERING;

NONLINEAR SYSTEMS;

EID: 33144465195     PISSN: 08954798     EISSN: 10957162     Source Type: Journal    
DOI: 10.1137/S0895479804442334     Document Type: Article

References (19)

1. G. BAUDAT AND F. ANOUAR, Generalized discriminant analysis using a kernel approach, Neural Comput., 12 (2000), pp. 2385-2404.
2. S. BILLINGS AND K. LEE, Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm, Neural Networks, 15 (2002), pp. 263-270.
3. C. BURGES, A tutorial on support vector machines for pattern recognition, Data Min. Knowl. Discov., 2 (1998), pp. 121-167.
4. L. CHEN, H. LIAO, M. KO, J. LIN, AND G. YU, A new LDA-based face recognition system which can solve the small sample size problem, Pattern Recognition, 33 (2000), pp. 1713-1726.
5. N. CRISTIANINI AND J. SHAWE-TAYLOR, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press, Cambridge, UK, 2000.
6. R. DUDA AND P. HART, Pattern Classification and Scene Analysis, Wiley-Interscience, New York, 1973.
7. R. DUDA, P. HART, AND D. STORK, Pattern Classification, Wiley-Interscience, New York, 2001.
8. J. FRIEDMAN, Regularized discriminant analysis, J. Amer. Statist. Assoc., 84 (1989), pp. 165-175.
9. K. FUKUNAGA, Introduction to Statistical Pattern Recognition, 2nd ed., Academic Press, New York, 1990.
10. P. HOWLAND, M. JEON, AND H. PARK, Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition, SIAM J. Matrix Anal. Appl., 25 (2003), pp. 165-179.
11. G. KOWALSKI, Information Retrieval System: Theory and Implementation, Kluwer Academic, Dordrecht, The Netherlands, 1997.
12. S. MIKA, G. RÄTSCH, J. WESTON, B. SCHÖLKOPF, AND K.-R. MÜLLER, Fisher discriminant analysis with kernels, in Neural Networks for Signal Processing IX, Y. H. Hu, J. Larsen, E. Wilson, and S. Douglas, eds., IEEE, Piscataway, NJ, 1999, pp. 41-48.
13. S. MIKA, G. RÄTSCH, J. WESTON, B. SCHÖLKOPF, A. SMOLA, AND K.-R. MÜLLER, Invariant feature extraction and classification in kernel spaces, Adv. Neural Inf. Process. Syst., 12 (2000), pp. 526-532.
14. C. H. PARK AND H. PARK, A Comparison of Generalized LDA Algorithms for Undersampled Problems, Tech, rep. 03-048, Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, 2003.
15. J. PLATT, N. CRISTIANINI, AND J. SHAWE-TAYLOR, Large margin dags for multiclass classification, Adv. Neural Inf. Process. Syst., 12 (2000), pp. 547-553.
16. V. ROTH AND V. STEINHAGE, Nonlinear discriminant analysis using kernel functions, Adv. Neural Inf. Process. Syst., 12 (2000), pp. 568-574.
17. B. SCHÖLKOPF, S. MIKA, C. BURGES, P. KNIRSCH, K.-R. MÜLLER, G. RÄTSCH, AND A. SMOLA, Input space versus feature space in kernel-based methods, IEEE Trans. Neural Networks, 10 (1999), pp. 1000-1017.
18. B. SCHÖLKOPF, A. SMOLA, AND K.-R. MÜLLER, Nonlinear component analysis as a kernel eigenvalue problem, Neural Comput., 10 (1998), pp. 1299-1319.
19. H. YU AND J. YANG, A direct LDA algorithm for high-dimensional data with application to face recognition, Pattern Recognition, 34 (2001), pp. 2067-2070.