A new and fast implementation for null space based linear discriminant analysis

Pattern Recognition

Volumn 43, Issue 4, 2010, Pages 1373-1379

  Chu, Delin ^a   Thye, Goh Siong ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Dimensionality reduction; Linear discriminant analysis; Null space based linear discriminant analysis; QR factorization; Singular value decomposition

Indexed keywords

DATA MATRICES; DIMENSIONALITY REDUCTION; EIGEN DECOMPOSITION; FAST IMPLEMENTATION; LINEAR DISCRIMINANT ANALYSIS; N-MATRIX; NULL SPACE; OPTIMAL TRANSFORMATION; ORTHOGONAL TRANSFORMATIONS; QR FACTORIZATIONS; REAL WORLD DATA; SAMPLE SIZES;

COMPUTATIONAL COMPLEXITY; DISCRIMINANT ANALYSIS; FACTORIZATION; IMAGE RETRIEVAL;

SINGULAR VALUE DECOMPOSITION;

EID: 74449090002     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.10.004     Document Type: Article

References (43)

1. Tao D., Li X., Wu X., and Maybank S.J. Geometric mean for subspace selection. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (2009) 260-274
2. Hamsici O.C., and Martinez A.M. Bayes optimality in linear discriminant analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (2008) 647-657
3. Guo Y., Hastie T., and Tibshirani R. Regularized linear discriminant analysis and its application in microarray. Biostatistics 8 (2007) 86-100
4. H. Park, B. Drake, S. Lee, C. Park, Fast linear discriminant analysis using QR decomposition and regularization, Technical Report GT-CSE-07-21.
5. Tao D., Li X., Wu X., and Maybank S.J. General averaged divergence analysis. ICDM (2007) 302-311
6. J. Ye, Least squares linear discriminant analysis, in: The Twenty-Fourth International Conference on Machine Learning (ICML 2007), 2007, pp. 1087-1093.
7. Wang L., and Shen X. On L1-norm multiclass support vector machines: methodology and theory. Journal of the American Statistical Association 102 (2007) 583-594
8. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer, Berlin
9. Ye J., and Xiong T. Computational and theoretical analysis of null space and orthogonal linear discriminant analysis. Journal of Machine Learning Research 7 (2006) 1183-1204
10. Hall P., Marron J.S., and Neeman A. Geometric representation of high dimensional, low sample size data. Journal of Royal Statistical Society Series B 67 (2005) 427-444
11. Ye J. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research 6 (2005) 483-502
12. Howland P., and Park H. Generalizing discriminant analysis using the generalized singular value decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (2004) 995-1006
13. Ye J., Janardan R., Park C.H., and Park H. An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (2004) 982-994
14. Dai D.Q., and Yuen P.C. Regularized discriminant analysis and its application to face recognition. Pattern Recognition 36 (2003) 845-847
15. Howland P., Jeon M., and Park H. Structure preserving dimension reduction for clustered text data based on the generalized singular value decomposition. SIAM Journal of Matrix Analysis and Applications 25 (2003) 165-179
16. Lu J., Plataniotis K.N., and Venetsanopoulos A.N. Face recognition using LDA based algorithms. IEEE Transactions on Neural Networks 14 (2003) 195-200
17. Baldi P., and Hatfield G.W. DNA Microarrays and Gene Expression: From Experiments to Data Analysis and Modeling (2002), Cambridge University Press, Cambridge
18. Dudoit S., Fridlyand J., and Speed T.P. Comparison of discrimination methods for the classification of tumors using gene expression data. Journal of the American Statistical Association 97 (2002) 77-87
19. R. Huang, Q. Liu, H. Lu, S. Ma, Solving the small sample size problem of LDA, in: Proceedings of International Conference on Pattern Recognition, 2002, pp. 29-32.
20. Jolliffe I.T. Principal Component Analysis. second ed. (2002), Springer, New York
21. Duda R.Q., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
22. Jin Z., Yang J.Y., Hu Z.S., and Lou Z. Face recognition based on the uncorrelated discriminant transformation. Pattern Recognition 34 (2001) 1405-1416
23. Jin Z., Yang J.Y., Tang Z.M., and Hu Z.S. A theorem on the uncorrelated optimal discriminant vectors. Pattern Recognition 34 (2001) 2041-2047
24. Loog M., Duin R.P.W., and Haeb-Umbach R. Multiclass linear dimension reduction by weighted pairwise fisher criteria. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001) 762-766
25. Chen L., Liao H.M., Ko M., Lin J., and Yu G. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33 (2000) 1713-1726
26. Lotlikar R., and Kothari R. Fractional-step dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 (2000) 623-627
27. Kowalski G. Information Retrieval Systems: Theory and Implementation (1997), Kluwer Academic Publishers, Dordrecht
28. Golub G.H., and Van Loan C.F. Matrix Computations. third ed. (1996), The Johns Hopkins University Press, Baltimore, Maryland
29. Swets D.L., and Weng J. Using discriminant eigenfeatures for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 (1996) 831-836
30. Berry M.W., Dumais S.T., and OBrie G.W. Using linear algebra for intelligent information retrieval. SIAM Review 37 (1995) 573-595
31. Frakes W.B., and Baeza-Yates R. Information Retrieval: Data Structures and Algorithms (1992), Prentice-Hall PTR
32. McLachlan G.J. Discriminant Analysis and Statistical Pattern Recognition (1992), Wiley, New York
33. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
34. Fukunaga K. Introduction to Statistical Pattern Recognition. second ed. (1990), Academic Press, New York
35. Friedman J.H. Regularized discriminant analysis. Journal of the American Statistical Association 84 (1989) 165-175
36. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice-Hall, Englewood Cliffs, NJ
37. Duchene L., and Leclerq S. An optimal transformation for discriminant and principal component analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 10 (1988) 978-983
38. Paige C.C., and Saunders M.A. Towards a generalized singular value decomposition. SIAM Journal on Numerical Analysis 18 (1981) 398-405
39. Van Loan C.F. Generalizing the Singular value decomposition. SIAM Journal on Numerical Analysis 13 (1976) 76-83
40. Ye J., Li Q., Xiong H., Park H., Janardan R., and Kumar V. IDR/QR: an incremental dimension reduction algorithm via QR decomposition. IEEE Transaction on Knowledge and Data Engineering 17 9 (2005) 1208-1221
41. Zuo W., Wang K., and Zhang D. Improvement on Null Space LDA for Face Recognition: A Symmetry Consideration (2005), Springer, Berlin, Heidelberg ICB 2006, Lecture Notes in Computer Sciences 3832, pp. 78-74
42. J. Yang, J.Y. Yang, Why can LDA be performed in PCA transformed space, Pattern Recognition 36 (2) (2003) 563-566.
43. J. Ye, T. Xiong, Null space versus orthogonal linear discriminant analysis, in: Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, 2006.