Multiclass classifiers based on dimension reduction with generalized LDA

Pattern Recognition

Volumn 40, Issue 11, 2007, Pages 2939-2945

  Kim, Hyunsoo ^a   Drake, Barry L ^a   Park, Haesun ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Dimension reduction; Generalized linear discriminant analysis (LDA); Generalized singular value decomposition (GSVD); Multiclass classifier; Undersampled problems

Indexed keywords

ALGORITHMS; DATA TRANSFER; INDEXING (OF INFORMATION); OPTIMIZATION; PARAMETER ESTIMATION; PROBLEM SOLVING;

DIMENSION REDUCTION; GENERALIZED LINEAR DISCRIMINANT ANALYSIS (LDA); GENERALIZED SINGULAR VALUE DECOMPOSITION (GSVD); MULTICLASS CLASSIFIERS; UNDERSAMPLED PROBLEMS;

CLASSIFICATION (OF INFORMATION);

EID: 34250837983     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.03.002     Document Type: Article

References (20)

1. Platt J.C., Cristianini N., and Shawe-Taylor J. Large margin DAGs for multiclass classification. Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge, MA 547-553
2. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer, New York
3. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
4. Fisher R.A. The use of multiple measurements in taxonomic problems. Ann. Eugenics 7 Part II (1936) 179-188
5. Howland P., Jeon M., and Park H. Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition. SIAM J. Matrix Anal. Appl. 25 1 (2003) 165-179
6. Howland P., and Park H. Generalizing discriminant analysis using the generalized singular value decomposition. IEEE Trans. Pattern Anal. Machine Intell. 26 8 (2004) 995-1006
7. Chen L., Liao H.M., Ko M., Lin J., and Yu G. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33 (2000) 1713-1726
8. Yu H., and Yang J. A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recognition 34 (2001) 2067-2070
9. Yang J., and Yang J.Y. Why can LDA be performed in PCA transformed space?. Pattern Recognition 36 (2003) 563-566
10. Park C.H., and Park H. A comparison of generalized LDA algorithms for undersampled problems Technical Report 03-048 (2003), Department of Computer Science and Engineering, University of Minnesota
11. Ma J., Perkins S., Theiler J., and Ahalt S. Modified kernel-based nonlinear feature extraction. International Conference on Machine Learning and Application (ICMLKA'02) (2002), Las Vegas, NV, USA
12. Kim H., Howland P., and Park H. Dimension reduction in text classification with support vector machines. J. Mach. Learn. Res. 6 January (2005) 37-53
13. Mika S., Rätsch G., Weston J., Schölkopf B., and Müller K.R. Fisher discriminant analysis with kernels. In: Hu Y.H., Larsen J., Wilson E., and Douglas S. (Eds). Neural Networks for Signal Processing vol. IX (1999), IEEE 41-48
14. Baudat G., and Anouar F. Generalized discriminant analysis using a kernel approach. Neural Comput. 12 10 (2000) 2385-2404
15. Park C.H., and Park H. Kernel discriminant analysis based on the generalized singular value decomposition, Technical Report 03-017 (2003), Department of Computer Science and Engineering, University of Minnesota
16. Ye J., Li T., Xiong T., and Janardan R. Using uncorrelated discriminant analysis for tissue classification with gene expression data. IEEE/ACM Trans. Comput. Biol. Bioinform. 1 4 (2004) 181-190
17. Fukunaga K. Introduction to Statistical Pattern Recognition. ed. (1990), Academic Press, Boston
18. Park C.H., and Park H. A fast dimension reduction algorithm with applications on face recognition and text classification Technical Report 03-050 (2003), Department of Computer Science and Engineering, University of Minnesota
19. Golub T.R., Slonim D.K., Tamayo P., Huard C., Gaasenbeek M., Mesirov J.P., Coller H., Loh M.L., Downing J.R., Caligiuri M.A., Bloomfield C.D., and Lander E.S. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286 (1999) 531-537
20. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998. URL 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.