On the equivalence of linear discriminant analysis and least squares

Proceedings of the National Conference on Artificial Intelligence

Volumn 4, Issue , 2015, Pages 2736-2742

  Lee, Kibok ^a,b   Kim, Junmo ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b SAMSUNG Electronics   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; DISCRIMINANT ANALYSIS; EIGENVALUES AND EIGENFUNCTIONS;

BETWEEN CLASS SCATTER; CLASSIFICATION METHODS; DEPENDENT VARIABLES; DIMENSIONALITY REDUCTION; GENERALIZED EIGENVALUE DECOMPOSITIONS (GEVD); LINEAR DISCRIMINANT ANALYSIS; TWO-STAGE ALGORITHM; WITHIN CLASS SCATTER;

MATRIX ALGEBRA;

EID: 84960145829     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Anderson, E. 1999. LAPACK Users' Guide, volume 9. SIAM.
2. Bache, K., and Lichman, M. 2013. UCI machine learning repository.
3. Bishop, C. 2006. Pattern Recognition and Machine Learning. Springer.
4. Cai, D.; He, X.; and Han, J. 2008. SRDA: An efficient algorithm for large-scale discriminant analysis. IEEE Transactions on Knowledge and Data Engineering 20(1):1-12.
5. Friedman, J. 1989. Regularized discriminant analysis. Journal of the American Statistical Association 84(405):165-175.
6. Fukunaga, K. 1990. Introduction to Statistical Pattern Recognition. Academic Press.
7. Georghiades, A.; Belhumeur, P.; and Kriegman, D. 2001. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6):643-660.
8. Goiub, G., and Van Loan, C. 1996. Matrix Computations. Johns Hopkins Univ Press, 3rd edition.
9. Hastie, T.; Tibshirani, R.; and Buja, A. 1994. Flexible discriminant analysis by optimal scoring. Journal of the American Statistical Association 89(428):1255-1270.
10. Jin, Z.; Yang, J.; Hu, Z.; and Lou, Z. 2001. Face recognition based on the uncorrelated discriminant transformation. Pattern Recognition 34(7):1405-1416.
11. LeCun, Y., and Cortes, C. 1998. The MNIST database of handwritten digits.
12. Lehoucq, R. B.; Sorensen, D. C.; and Yang, C. 1998. ARPACK Users' Guide: Solution of Large-scale Eigenvalue Problems with Implicitly Restarted Arnoldi Methods, volume 6. SIAM.
13. Penrose, R. 1955. A generalized inverse for matrices. In Proceedings of the Cambridge Philosophical Society, volume 51, 406-413. Cambridge Univ Press.
14. Stewart, G. 2001. Matrix Algorithms: Eigensystems, volume 2. Society for Industrial Mathematics.
15. Sun, L.; Ceran, B.; and Ye, J. 2010. A scalable two-stage approach for a class of dimensionality reduction techniques. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 313-322. ACM.
16. Ye, J. 2006. Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems. Journal of Machine Learning Research 6(1):483-502.
17. Ye, J. 2007. Least squares linear discriminant analysis. In Proceedings of the 24th International Conference on Machine Learning, 1087-1093. ACM.
18. Zhang, Z.; Dai, G.; Xu, C.; and Jordan, M. I. 2010. Regularized discriminant analysis, ridge regression and beyond. Journal of Machine Learning Research 99:2199-2228.