SRDA: An efficient algorithm for large scale discriminant analysis

IEEE Transactions on Knowledge and Data Engineering

Volumn 20, Issue 1, 2008, Pages 1-12

  Cai, Deng ^b   He, Xiaofei ^c   Han, Jiawei ^a,b  

^a IEEE   (United States)

^b University of Illinois at Urbana Champaign   (United States)

^c YAHOO INC   (United States)

Author keywords

Dimensionality reduction; Linear discriminant analysis; Spectral regression

Indexed keywords

COMPUTATIONAL EFFICIENCY; DATA MINING; EIGENVALUES AND EIGENFUNCTIONS; LARGE SCALE SYSTEMS; OPTIMIZATION; REGRESSION ANALYSIS;

DIMENSIONALITY REDUCTION; LINEAR DISCRIMINANT ANALYSIS (LDA); SPECTRAL REGRESSION; SPECTRAL REGRESSION DISCRIMINANT ANALYSIS (SRDA);

DISCRIMINANT ANALYSIS;

EID: 36649009540     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2007.190669     Document Type: Article

References (28)

1. P. N. Belhumeur, J. P. Hepanha, and D. J. Kriegman. Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):711-720, 1997.
2. D. Cai, X. He, and J. Han. Efficient kernel discriminant analysis via spectral regression. In Proc. Int. Conf. on Data Mining (ICDM'07), 2007.
3. D. Cai, X. He, and J. Han. Spectral regression: A unified approach for sparse subspace learning. In Proc. Int. Conf. on Data Mining (ICDM'07), 2007.
4. D. Cai, X. He, and J. Han. Spectral regression: A unified subspace learning framework for content-based image retrieval. In Proceedings of the ACM Conference on Multimedia, 2007.
5. D. Cai, X. He, and J. Han. Spectral regression for efficient regularized subspace learning. In Proc. Int. Conf. Computer Vision (ICCV'07), 2007.
6. D. Cai, X. He, W. V. Zhang, and J. Han. Regularized locality preserving indexing via spectral regression. In Proc. 2007 ACM Int. Conf. on Information and Knowledge Management (CIKM'07), 2007.
7. F. R. K. Chung. Spectral Graph Theory, volume 92 of Regional Conference Series in Mathematics. AMS, 1997.
8. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. WileyInterscience, Hoboken, NJ, 2nd edition, 2000.
9. J. H. Friedman. Regularized discriminant analysis. Journal of the American Statistical Association, 84(405): 165-175, 1989.
10. K. Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, 2nd edition, 1990.
11. V. Gaede and O. Günther. Multidimensional access methods. ACM Comput. Surv., 30(2):170-231, 1998.
12. G. H. Golub and C. F. V. Loan. Matrix computations. Johns Hopkins University Press, 3rd edition, 1996.
13. T. Hastie, A. Buja, and R. Tibshirani. Penalized discriminant analysis. Annals of Statistics, 23:73-102, 1995.
14. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: SpringerVerlag, 2001.
15. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang. Face recognition using laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3):328-340, 2005.
16. P. Howland and H. Park. Generalizing discriminant analysis using the generalized singular value decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(8):995-1006, 2004.
17. K. Lang. Newsweeder: Learning to filter netnews. In Proceedings of the Twelfth International, Conference on Machine Learning, pages 331-339, 1995.
18. C. C. Paige and M. A. Saunders. Algorithm 583 LSQR: Sparse linear equations and least squares problems. ACM Transactions on Mathematical Software, 8(2):195-209, June 1982.
19. C. C. Paige and M. A. Saunders. LSQR: An algorithm for sparse linear equations and sparse least squares. ACM Transactions on Mathematical Software., 8(1):43-71, March 1982.
20. R. Penrose. A generalized inverse for matrices. In Proceedings of the Cambridge Philosophical Society, volume 51, pages 406-413, 1955.
21. G. W. Stewart. Matrix Algorithms Volume I: Basic Decompositions. SIAM, 1998.
22. G. W. Stewart. Matrix Algorithms Volume II: Eigensystems. SIAM, 2001.
23. D. L. Swets and J. Weng. Using discriminant eigenfeatures for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(8):831-836, 1996.
24. K. Torkkola. Linear discriminant analysis in document classification. In Proc. IEEE ICDM Workshop Text Mining, 2001.
25. J. Ye. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research, (6):483-502, 2005.
26. J. Ye, Q. Li, H. Xiong, H. Park, R. Janardan, and V. Kumar. IDR/QR: an incremental dimension reduction algorithm via QR decomposition. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining (KDD'04), pages 364-373, 2004.
27. J. Ye and T. Wang. Regularized discriminant analysis for high dimensional, low sample size data. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD'06), pages 454-463, 2006. Recent Reference Since the Article Was Submitted
28. J. Ye. Least squares linear discriminant analysis. In The Twenty-Fouth International Conference on Machine Learning, 2007.