Regularized least squares fisher linear discriminant with applications to image recognition

Neurocomputing

Volumn 122, Issue , 2013, Pages 521-534

  Chen, Xiaobo ^a,b   Yang, Jian ^b   Mao, Qirong ^a   Han, Fei ^a  

^a JIANGSU UNIVERSITY   (China)

^b NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

2 Norm loss function; Concave convex programming (CCP); Linear discriminant analysis (LDA); Regularization technique

Indexed keywords

CONCAVE-CONVEX PROGRAMMING (CCP); DIMENSION REDUCTION METHOD; FISHER LINEAR DISCRIMINANTS; GENERALIZATION PERFORMANCE; LINEAR DISCRIMINANT ANALYSIS; LOSS FUNCTIONS; REGULARIZATION TECHNIQUE; REGULARIZED LINEAR DISCRIMINANT ANALYSIS (R-LDA);

CONVEX PROGRAMMING; IMAGE RECOGNITION; LAGRANGE MULTIPLIERS; OBJECT RECOGNITION; OPTIMIZATION; QUADRATIC PROGRAMMING;

PROBLEM SOLVING;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; IMAGE ANALYSIS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; REGULARIZED LEAST SQUARES FISHER LINEAR DISCRIMINANT; REGULARIZED LINEAR DISCRIMINANT ANALYSIS; STATISTICAL ANALYSIS; THEORETICAL STUDY;

EID: 84884205226     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.05.006     Document Type: Article

References (40)

1. Jolliffe I.T. Principal Component Analysis 2002, Wiley Online Library.
2. Fukunaga K. Introduction to Statistical Pattern Recognition 1990, Academic Press.
3. Fan Z., Xu Y., Zhang D. Local linear discriminant analysis framework using sample neighbors. IEEE Trans. Neural Networks 2011, 22:1119-1132.
4. M.A. Turk, A.P. Pentland, Face recognition using eigenfaces, in: Proc. CVPR91, 1991, 586-591.
5. P. Belhumeur, J. Hespanha, D. Kriegman, Eigenfaces vs. fisherfaces: recognition using class specific linear projection, in: Proc. ECCV96, 1996 43-58.
6. Xu Y., Zhong A., Yang J., Zhang D. LPP solution schemes for use with face recognition. Pattern Recognit. 2010, 43:4165-4176.
7. Martinez A.M., Kak A.C. Pca versus lda. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23:228-233.
8. Lu J., Plataniotis K.N., Venetsanopoulos A.N. Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition. Pattern Recognit. Lett. 2005, 26:181-191.
9. Dai D.Q., Yuen P.C. Face recognition by regularized discriminant analysis. IEEE Trans. Syst. Man Cybern. Part B Cybern. 2007, 37:1080-1085.
10. Friedman J.H. Regularized discriminant analysis. J. Am. Stat. Assoc. 1989, 165-175.
11. Yang J. Why can LDA be performed in PCA transformed space?. Pattern Recognit. 2003, 36:563-566.
12. Tao D., Li X., Wu X., Maybank S.J. Geometric mean for subspace selection. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31:260-274.
13. Loog M., Duin R.P.W., Haeb-Umbach R. Multiclass linear dimension reduction by weighted pairwise Fisher criteria. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23:762-766.
14. B. Xu, K. Huang, C.L. Liu, Dimensionality reduction by minimal distance maximization, in: Proc. ICPR10, 2010, 569-572.
15. Bian W., Tao D. Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 1037-1050.
16. Q. Ye, C. Zhao, H. Zhang, X. Chen, Recursive Concave-Convex Fisher Linear Discriminant with Applications to Face, Handwritten Digit and Terrain Recognition Pattern Recognition, 45, 2012, 54-65.
17. Jayadeva R., Khemchandani S.Chandra Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29:905-910.
18. Chen X., Yang J., Ye Q., Liang J. Recursive projection twin support vector machine via within-class variance minimization. Pattern Recognit. 2011, 44:2643-2655.
19. Vapnik V.N. The Nature of Statistical Learning Theory 1995, Springer-Verlag, New York.
20. Suykens J., Vandewalle J. Least squares support vector machine classifiers. Neural Process. Lett. 1999, 9:293-300.
21. Chen X., Yang J., Liang J., Ye Q. Recursive robust least squares support vector regression based on maximum correntropy criterion. Neurocomputing 2012, 97:63-73.
22. Chen X., Yang J., Liang J. Optimal locality regularized least squares support vector machine via alternating optimization. Neural Process. Lett. 2011, 33:301-315.
23. Shao Y.H., Deng N.Y., Yang Z.M. Least squares recursive projection twin support vector machine for classification. Pattern Recognit. 2012, 45:2299-2307.
24. Yuille A.L., Rangarajan A. The concave-convex procedure. Neural Comput. 2003, 15:915-936.
25. Sun W., Yuan Y. Optimization Theory and Methods: Nonlinear Programming 2006, Springer Verlag.
26. Cortes C., Vapnik V. Support-vector networks. Mach. Learn. 1995, 20:273-297.
27. Wang F., Zhao B., Zhang C. Linear time maximum margin clustering. IEEE Trans. Neural Networks 2010, 21:319-332.
28. B. Zhao, F. Wang, C. Zhang, Efficient maximum margin clustering via cutting plane algorithm, in:. Proc. SIAM, 2008, 751-762.
29. Sugiyama M. Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. J. Mach. Learn. Res. 2007, 8:1027-1061.
30. Golub G.H., Van Loan C.F. Matrix Computations 1996, Johns Hopkins Univ Press.
31. Petersen K.B., Pedersen M.S. The matrix cookbook. Tech. Univ. Den. 2008, 7-15.
32. Handwritten digit database (Online Available). http://www.cs.nyu.edu/~roweis/data.html.
33. T. Sim, S. Baker, M. Bsat, The CMU pose, illumination, and expression (PIE) database, in: Proc. AFGR, 2002, 46-51.
34. A. Martinez, R. Benavente, The AR face database, Computer Vision Center, Universitat Autónoma de Barcelona, CVC Technical Report, 24, 1998.
35. Nene S.A., Nayar S.K., Murase H. Columbia Object Image Library (coil-20) 1996, Dept. Comput. Sci., Columbia Univ, New York.
36. Qiao L., Chen S., Tan X. Sparsity preserving projections with applications to face recognition. Pattern Recognit. 2010, 43:331-341.
37. Jenatton R., Audibert J.Y., Bach F. Structured variable selection with sparsity-inducing norms. Arxiv preprint arXiv 2009, 0904:3523.
38. Lai Z., Wan M., Jin Z., Yang J. Sparse two-dimensional local discriminant projections for feature extraction. Neurocomputing 2011, 74:629-637.
39. Georghiades A.S., Belhumeur P.N., Kriegman D.J. From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23(6):643-660.
40. Wang Zhe, Chen Songcan, Sun Tingkai MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:348-353.