Structural max-margin discriminant analysis for feature extraction

Knowledge-Based Systems

Volumn 70, Issue , 2014, Pages 154-166

  Chen, Xiaobo ^a   Xiao, Yan ^a   Cai, Yinfeng ^a   Chen, Long ^a  

^a JIANGSU UNIVERSITY   (China)

Author keywords

Column generation; Constrained concave convex procedure; Discriminant analysis; Max margin principle; Quadratic programming

Indexed keywords

DIMENSIONALITY REDUCTION; EXTRACTION; FEATURE EXTRACTION; LINEAR PROGRAMMING; QUADRATIC PROGRAMMING;

COLUMN GENERATION; CONSTRAINED CONCAVE-CONVEX PROCEDURES; DIMENSIONALITY REDUCTION TECHNIQUES; FEATURE EXTRACTION METHODS; INTRINSIC STRUCTURES; MAX-MARGIN PRINCIPLE; NONCONVEX OPTIMIZATION PROBLEM; SUBCLASS DISCRIMINANT ANALYSES (SDA);

DISCRIMINANT ANALYSIS;

EID: 84908479126     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2014.06.020     Document Type: Article

References (41)

1. I. Jolliffe, Principal component analysis, Encyclopedia of Statistics in Behavioral Science, 2002.
2. Ingwer Borg Modern Multidimensional Scaling: Theory and Applications 2005 Springer
3. P. Belhumeur, J. Hespanha, D. Kriegman, Eigenfaces vs. fisherfaces: recognition using class specific linear projection, in: European Conference on Computer Vision, 1996, pp. 43-58.
4. K. Fukunaga Introduction to Statistical Pattern Recognition 1990 Academic Press
5. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326
6. J.B. Tenenbaum, V. Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
7. X. He, P. Niyogi, Locality preserving projections, in: Advances in Neural Information Processing Systems, 2004.
8. X. He, D. Cai, S. Yan, H. Zhang, Neighborhood preserving embedding, in: International Conference on Computer Vision, 2005, pp. 1208-1213.
9. D. Cai, X. He, J. Han, Isometric projection, in: AAAI Conference on Artificial Intelligence, 2007, pp. 528-533.
10. S. Yan, D. Xu, B. Zhang, H.J. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: a general framework for dimensionality reduction IEEE Trans. Pattern Anal. Mach. Intell. 29 1 2007 40 51
11. H.T. Chen, H.W. Chang, T.L. Liu, Local discriminant embedding and its variants, in: IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 846-853.
12. D. Cai, X. He, K. Zhou, J. Han, H. Bao, Locality sensitive discriminant analysis, in: International Joint Conference on Artificial Intelligence, 2007, pp. 708-713.
13. M. Sugiyama Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis J. Mach. Learn. Res. 8 2007 1027 1061
14. D. Xu, S. Yan, D. Tao, S. Lin, and H. Zhang Marginal fisher analysis and its variants for human gait recognition and content-based image retrieval IEEE Trans. Image Process. 16 11 2007 2811 2821
15. G.F. Lu, Z. Lin, and Z. Jin Face recognition using discriminant locality preserving projections based on maximum margin criterion Pattern Recogn. 43 10 2010 3572 3579
16. Y. Zhao, S. Xu, Y. Jia, Discriminant clustering embedding for face recognition with image sets, in: Asian Conference on Computer Vision, 2007, pp. 641-650.
17. M. Zhu, and A.M. Martinez Subclass discriminant analysis IEEE Trans. Pattern Anal. Mach. Intell. 28 8 2006 1274 1286
18. G. Orfanidis, A. Tefas, Exploiting subclass information in support vector machines, in: International Conference on Pattern Recognition, 2012, pp. 1076-1079.
19. S. Nikitidis, A. Tefas, N. Nikolaidis, and I. Pitas Subclass discriminant nonnegative matrix factorization for facial image analysis Pattern Recogn. 45 12 2012 4080 4091
20. H. Xue, S. Chen, and Q. Yang Structural regularized support vector machine: a framework for structural large margin classifier IEEE Trans. Neural Networ. 22 4 2011 573 587
21. Z. Qi, Y. Tian, and Y. Shi Structural twin support vector machine for classification Knowl.-Based Syst. 43 2013 74 81
22. X. Peng, Y. Wang, and D. Xu Structural twin parametric-margin support vector machine for binary classification Knowl.-Based Syst. 49 2013 63 72
23. B. Xu, K. Huang, C.L. Liu, Dimensionality reduction by minimal distance maximization, in: International Conference on Pattern Recognition, 2010, pp. 569-572.
24. Q. Ye, C. Zhao, H. Zhang, and X. Chen Recursive concave-convex fisher linear discriminant with applications to face, handwritten digit and terrain recognition Pattern Recogn. 45 1 2012 54 65
25. C. Cortes, and V. Vapnik Support-vector networks Mach. Learn. 20 3 1995 273 297
26. X. Chen, J. Yang, Q. Ye, and J. Liang Recursive projection twin support vector machine via within-class variance minimization Pattern Recogn. 44 10-11 2011 2643 2655
27. X. Chen, J. Yang, J. Liang, and Q. Ye Recursive Robust least squares support vector regression based on maximum correntropy criterion Neurocomputing 97 2012 63 73
28. V.N. Vapnik Statistical Learning Theory 1998 Wiley New York
29. T. Hastie, R. Tibshirani, and J.J.H. Friedman The Elements of Statistical Learning 2001 Springer New York
30. S. Salvador, P. Chan, Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms, in: International Conference on Tools with Artificial Intelligence, 2004, pp. 576-584.
31. J.H. Ward Jr. Hierarchical grouping to optimize an objective function J. Am. Stat. Assoc. 58 301 1963 236 244
32. Y.H. Shao, Z. Wang, W.J. Chen, and N.Y. Deng A regularization for the projection twin support vector machine Knowl.-Based Syst. 37 2013 203 210
33. X. Chen, J. Yang, Q. Mao, and F. Han Regularized least squares fisher linear discriminant with applications to image recognition Neurocomputing 122 2013 521 534
34. S. Boyd, and L. Vandenberghe Convex Optimization 2004 Cambridge Univ. Pr.
35. A.L. Yuille, and A. Rangarajan The concave-convex procedure Neural Comput. 15 4 2003 915 936
36. F. Wang, B. Zhao, and C. Zhang Unsupervised large margin discriminative projection IEEE Trans. Neural Networ. 22 9 2011 1446 1456
37. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf Large scale multiple kernel learning J. Mach. Learn. Res. 7 2006 1531 1565
38. B. Zhao, F. Wang, C. Zhang, Efficient maximum margin clustering via cutting plane algorithm, in: SIAM International Conference on Data Mining, pp. 751-762.
39. C. Blake, C. Merz, UCI repository of machine learning databases (1998).
40. Y. Sun, S. Todorovic, and S. Goodison Local-learning-based feature selection for high-dimensional data analysis IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1610 1626
41. J.J.Y. Wang, H. Bensmail, N. Yao, and X. Gao Discriminative sparse coding on multi-manifolds Knowl.-Based Syst. 54 2013 199 206