Recursive "concave-convex" Fisher Linear Discriminant with applications to face, handwritten digit and terrain recognition

Pattern Recognition

Volumn 45, Issue 1, 2012, Pages 54-65

  Ye, Q L ^a   Zhao, C X ^a   Zhang, H F ^a   Chen, X B ^a  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Extracting features; Fisher Linear Discriminant; Recursive concaveconvex dimension reduction

Indexed keywords

DIMENSION REDUCTION; DIMENSION REDUCTION TECHNIQUES; EIGEN-VALUE; EXTRACTING FEATURES; FACE IMAGE DATABASE; FISHER LINEAR DISCRIMINANTS; HANDWRITTEN DIGIT; HIGH DIMENSIONAL DATA; IMAGE DATASETS; MULTI-CLASS; OPTIMIZATION PROBLEMS; PROGRAMMING PROBLEM; RECURSIVE PROCEDURE; UPPER BOUND;

ALGORITHMS; DATA PROCESSING; EIGENVALUES AND EIGENFUNCTIONS; FACE RECOGNITION; LANDFORMS;

CHARACTER RECOGNITION;

EID: 80052759348     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.07.008     Document Type: Article

References (44)

1. M. Turk, A.P. Pentland. Face Recognition Using Eigenfaces, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1991.
2. I.T. Jolliffe Principal Component Analysis 1986 Springer-Verlag New York
3. P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 1997 711 720 (Pubitemid 127762263)
4. K. Fukunaga Introduction to Statistical Pattern Classification 1990 Academic San Diego, CA
5. D. Cai, X. He, K. Zhou, J. Han, and H. Bao Locality sensitive discriminant analysis IJCAI 2007 708 713
6. M. Turk, and A. Pentland Eigenfaces for Recognition Journal of Cognitive Neuroscience 3 1 1991 71 86
7. K. Liu, Y.Q. Cheng, J.Y. Yang, and X. Liu. An efficient algorithm for Foley-Sammon optimal set of discriminant vectors by algebraic method International Journal of Pattern Recognition and Artificial Intelligence 6 5 1992 817 829
8. D.L. Swets, and J. Weng Using discriminant eigenfeatures for image retrieval IEEE Transactions on Pattern Analysis and Machine Intelligence 18 8 1996 831 836 (Pubitemid 126772824)
9. K. Etemad, and R. Chellappa Discriminant analysis for recognition of human face images Journal of the Optical Soceity of America A 14 1997 1724 1733 (Pubitemid 127569239)
10. D. Cai, X.F. He, Manifold Adaptive Experimental Design for Text Categorization, in: Proceedings of IEEE Transactions on Knowledge and Data Engineering, in press, doi: 10.1109/TKDE.2011.104.
11. C. Xiang, X.A. Fan, and T.H. Lee Face recognition using recursive fisher linear discriminant IEEE Transactions on Image Process 15 8 2006 2097 2105 (Pubitemid 44089086)
12. C. Liu, and H. Wechsler Robust coding schemes for indexing and retrieval from large face databases IEEE Transactions on Image Process 9 1 2000 132 137 (Pubitemid 30562090)
13. T. Hastie, A. Buja, and R. Tibshirani Penalized discriminant analysis Annals of Statistics 23 1 1995 73 102
14. T. Hastie, R. Tibshirani, and A. Buja Flexible discriminant analysis by optimal scoring, J American Statistical Association 89 428 1994 1255 1270
15. R. Huang, Q. Liu, H. Lu, S. Ma. Solving the small-sample-size problem of LDA, in: Proceedings of 16th International Conference on Pattern Recognition, 2002, vol. 3, pp. 2932.
16. X. Jiang, B. Mandal, and A. Kot Eigenfeature regularization and extraction in face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 30 3 2008 383 394 (Pubitemid 351280047)
17. A.K. Qin, P.N. Suganthan, and M. Loog Generalized null-space uncorrelated Fisher discriminant analysis for linear dimensionality reduction Pattern Recognition 39 9 2006 1805 1808 (Pubitemid 43867580)
18. T. Zhang, and B. Fang Generalized discriminant analysis: a matrix exponential approach IEEE Transactions on Systems, Man, and Cybernetics - Part B 40 1 2010 186 197
19. K. Torkkola. Linear discriminant analysis in document classification, in: Proceedings of IEEE ICDM Workshop Text Mining, 2001, pp. 401404.
20. X.B. Yang, S.C. Chen, B. Chen, and Z.S. Pan Proximal support vector machine using local information Neurocomputing 2009 1227 1234
21. O.L. Mangasarian, and E.W. Wild Multisurface proximal support vector classification via generalized eigenvalues IEEE Transactions on Pattern Analysis and Machine Intelligence 28 1 2006 69 74 (Pubitemid 46395305)
22. Q. Ye, C. Zhao, N. Ye, and Y. Chen Multi-weight vector projection support vector machines Pattern Recognition Letters 31 13 2010 2006 2011
23. R. Jayadeva, and S. Khemchandani Chandra, Twin Support Vector Machines for pattern classification IEEE Transactions of Pattern Analysis and Machine Intelligence 29 2007 905 910
24. Xiaobo Chen, Jian Yang, Qiaolin Ye, and Jun Liang Recursive Projection Twin Support Vector Machine via Within-Class Variance Minimization Pattern Recognition 44 1011 2011 2643 2655
25. Sebastian Mika, Gunnar Rätsch, and Klaus-Robert Müller A Mathematical Programming Approach to the Kernel Fisher Algorithm NIPS 2001
26. L. Sun, S.W. Ji, Jieping Ye. A least squares formulation for a class of generalized eigenvalue problems in machine learning, in: Proceedings of the 26th International Conference on Machine Learning, Montreal, Canada, 2009.
27. Q. Tao, D. Chu, and J. Wang Recursive support vector machines for dimensionality reduction IEEE Transactions on Neural Networks 19 2008 189 193 (Pubitemid 351279237)
28. C. Xiang, X. Fan, and T. Lee Face recognition using recursive Fisher linear discriminant IEEE Transactions on Image Process 15 8 2006 2097 2105 (Pubitemid 44089086)
29. B. Moghaddam, Y. Weiss, S. Avidan. Generalized spectral bounds for sparse LDA, In: ICML 06 Proceedings of the 23rd international Conference on Machine Learning, 2006, pp. 641648.
30. S. Masashi Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis Journal of Machine Learning Research 2007 1027 1061
31. X.F. He, S. Yan, Y.X. Hu, P. Niyogi, and H. Zhang. Face recognition using Laplacianfaces IIEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 2005 328 340 (Pubitemid 40377326)
32. A.J. Smola, S. Vishwanathan, T. Hofmann. Kernel methods for missing variables. In AISTATS, 2005.
33. Bin Zhao, Fei Wang, Changshui Zhang. Efficient maximum margin clustering via cutting plane algorithm, in: Proceedings of SDM2008, pp. 751762.
34. P.M. Cheung, J.T. Kowk. A regularization frame work for multiple-instance learning, in: Proceedings of the 23rd International Conference on Machine Learning, 2006.
35. P. Belhumeur, J. Hespanha, and D. Kriegman Eigenfaces vs. Fisherfaces: recognition using class specific linear projection Computer Vision ECCV96 1996 43 58
36. J. Yang Why can LDA be performed in PCA transformed space? Pattern Recognition 36 2003 563 566 (Pubitemid 35212848)
37. J. Yang, D. Zhang, J.Y. Yang, and B. Niu Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 29 2007 650 664 (Pubitemid 46464405)
38. J. Duchene, and S. Leclercq An optimal transformation for discriminant and principal component analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 10 6 1988 978 983
39. Yale. Face Database. (Online), available from: 〈http://cvc.yale.edu/ projects/yalefaces/yalefaces.html〉.
40. ORL. Face Database. (online), available from: 〈http://www.uk. research.att.com/facedatabase.html〉.
41. Handwritten. Digit Dataset. (online), 〈http://www.cs.nyu.edu/roweis/ data.html〉.
42. Outex Database. (online), 〈http://www.outex.oulu.fi〉.
43. P. Matti, N. Tom, M. Topi, and T. Markus View-based recognition of real-world textures Pattern Recognition 37 2 2005 313 323
44. T. Ojala, M. Pietikäinen, and T. Mäenpää Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Transactions on Pattern Analysis and Machine Intelligence 24 7 2002 971 987 (Pubitemid 34835471)