Manifold discriminant regression learning for image classification

Neurocomputing

Volumn 166, Issue , 2015, Pages 475-486

  Lu, Yuwu ^a   Lai, Zhihui ^b   Fan, Zizhu ^c   Cui, Jinrong ^d   Zhu, Qi ^e  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b SHENZHEN UNIVERSITY   (China)

^c EAST CHINA JIAOTONG UNIVERSITY   (China)

^d SOUTH CHINA AGRICULTURAL UNIVERSITY   (China)

^e NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Discriminant; Image classification; Linear regression; Manifold regularization

Indexed keywords

LINEAR REGRESSION; LINEAR TRANSFORMATIONS; MATRIX ALGEBRA; METADATA;

CLASSIFICATION TASKS; DISCRIMINANT; FEATURE EXTRACTION AND CLASSIFICATION; LEAST SQUARE REGRESSION; MANIFOLD REGULARIZATIONS; REGULARIZATION TERMS; RELATED ALGORITHMS; TRANSFORMATION MATRICES;

IMAGE CLASSIFICATION;

ALGORITHM; AR DATABASE; ARTICLE; CLASSIFICATION ALGORITHM; CMU PIE DATABASE; COIL 20 DATABASE; COMPARATIVE STUDY; DATA BASE; DISCRIMINANT ANALYSIS; EXTRACTION; FERET DATABASE; IMAGE CLASSIFICATION; IMAGING AND DISPLAY; LINEAR REGRESSION ANALYSIS; MACHINE LEARNING; MANIFOLD DISCRIMINANT REGRESSION LEARNING; MATHEMATICAL COMPUTING; MEASUREMENT ACCURACY; ORL DATA DATABASE; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS OPTIMIZATION; REGRESSION ANALYSIS; ROBUST MANIFOLD DISCRIMINANT REGRESSION LEARNING; STATES OF THE ART ALGORITHM;

EID: 84931574379     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.03.031     Document Type: Article

References (45)

1. C. Saunders, A. Gammerman, V. Vovk, Ridge regression learning algorithm in dual variables, in: Proceedings of the 15th International Conference on Machine Learning, Morgan Kaufmann, 1998, pp. 515-521.
2. Huang G.B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2012, 42(2):513-529.
3. Naseem I., Togneri R., Bennamoun M. Linear regression for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(11):2106-2112.
4. Ren C., Dai D., Yan H. Robust classification using l21-norm based regression model. Pattern Recognit. 2012, 45:2708-2718.
5. Chen X., Yang J., Mao Q., Han F. Regularized least squaresfisher linear discriminant with applications to image recognition. Neurocomputing 2013, 122:521-534.
6. Abdi H. Partial least squares regression (PLS-regression). Encycl. Res. Methods Soc. Sci. 2003, 792-795.
7. Ruppert D., Wand M.P. Multivariate locally weighted least squares regression. Ann. Stat. 1994, 22(3):1346-1370.
8. Li Y.F., Ngom A. Nonnegative least-squares methods for the classification of high-dimensional biological data. IEEE Trans. Comput. Biol. Bioinforma. 2013, 10(2):447-456.
9. Leski J. Ho-Kashyap classifier with generalization control. Pattern Recognit. Lett. 2003, 24(14):2281-2290.
10. Xiang S.M., Nie F.P., Meng G.F., Pan C.H., Zhang C.S. Discriminative least squares regressions for multiclass classification and feature selection. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(11):1738-1754.
11. Xu Y., Feng G., Zhao Y. One improvement to two-dimensional locality preserving projection method for use with face recognition. Neurocomputing 2009, 73(1-3):245-249.
12. Liu X., Yan S., Jin H. Projective nonnegative graph embedding. IEEE Trans. Image Process. 2010, 19(5):1126-1137.
13. Yang W., Sun C., Zhang L., Ricanek K. Laplacian bidirectional PCA for face recognition. Neurocomputing 2010, 74:487-493.
14. Xu Y., Zhong A., Yang J., Zhang D. LPP solution schemes for use with face recognition. Pattern Recognit. 2010, 43(12):4165-4176.
15. Zhao H. Combining labeled and unlabeled data with graph embedding. Neurocomputing 2006, 69:2385-2389.
16. Roweis S., Saul L. Nonlinear dimensionality reduction by locally linear embedding. Science 2000, 290(22):2323-2326.
17. Tenenbaum J., Silva V., Langford J. A global geometric framework for nonlinear dimensionality reduction. Science 2000, 290(22):2319-2323.
18. He X., Yan S., Hu Y., Niyogi P., Zhang H. Face recognition using Laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27(3):328-340.
19. Schneider P., Bunte K., Stiekema H., Hammer B., Villmann T., Biehl M. Regularization in matrix relevance learning. IEEE Trans. Neural Netw. 2010, 21(5):831-840.
20. Xu Z., King I., Lyu M.R.-T., Jin R. Discriminative semisupervised feature selection via manifold regularization. IEEE Trans. Neural Netw. 2010, 21(7):1033-1047.
21. Yan S., Xu D., Zhang B., Zhang H.J., Yang Q., Lin S. Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(1):40-51.
22. Wright J., Ganesh A., Rao S., Peng Y., Ma Y. Robust principal component analysis: exact recoveryof corrupted low-rank matrices via convex optimization. Proceedings of the Neural Information Processing Systems 2009, 1-9.
23. Candès E.J., Li X., Ma Y., Wright J. Robust principal component analysis. J. ACM 2009, 58(3):1-17.
24. Martinez A.M., Kak A.C. PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 2001, 23(2):228-233.
25. Ji H., Liu C., Shen Z., Xu Y. Robust video denoising using low rank matrix completion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2010, 1791-1798.
26. Bao B.K., Liu G., Xu C., Yan S. Inductive robust principal component analysis. IEEE Trans. Image Process. 2012, 21(8):3794-3800.
27. Cai D., He X., Wu X., Han J., Huang T.S. Graph Regularized Nonnegative Matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33(8):1548-1560.
28. F. Nie, H. Huang, X. Cai, C. Ding, Efficient and robust feature selection via joint l2, 1-norms minimization, in: Proceedings of the Advances in Neural Information Processing Systems, 2010.
29. H. Wang, F. Nie, H. Huang, S. Risacher, C. Ding, A.J. Saykin, L. Shen, ADNI, Sparse multi-task regression and feature selection to identify brain imaging predictors for memory performance, in: Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), 2011, pp. 557-562.
30. Qian Y., Jia S., Zhou J., Robles-Kelly A. Hyperspectral unmixing via sparsity-constrained nonnegative matrix factorization. IEEE Trans. Geosci. Remote Sens. 2011, 49(11):4282-4297.
31. Xiang S., Nie F., Pan C., Zhang C. Regression reformulations of LLE and LTSA with locally linear transformation. IEEE Trans. Syst. Man Cybern. B Cybern. 2011, 42(5):1250-1262.
32. Peng Y., Ganesh A., Wright J., Xu W., Ma Y. RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition June 2010, 763-770.
33. Z. Lin, M. Chen, L. Wu, Y. Ma, The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices, Department of Computer Engineering, University of Illinois, Champaign, IL, USA, Technical Report UIUC UILU-ENG-09-2214, 01, 2009.
34. Bertsekas D. Constrained Optimization and Lagrange Multiplier Methods 1982, Academic Press, San Diego, CA, USA.
35. Cai J., Candès E.J., Shen Z. A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 2010, 20(4):1956-1982.
36. Available: . http://www.itl.nist.gov/iad/humanid/feret/feret_master.html.
37. Phillips P.J., Moon H., Rizvi S.A., Rauss P.J. The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22(10):1090-1104.
38. Sim T., Baker S., Bsat M. The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25(12):1615-1618.
39. F.S. Samaria, A.C. Harter, Parameterisation of a stochastic model for human face identification, in: Proceedings of the 2nd IEEE Int. Workshop on Applied Computer Vision, Sarasota, FL, December 1994, pp. 138-142.
40. Wang S., Yang J., Zhang N., Zhou C.-G. Tensor discriminant color space for face recognition. IEEE Trans. Image Process. 2011, 20(9):2490-2501.
41. S. Nene, S. Nayar, H. Murase, Columbia object image library (COIL-20), Department of Computer Science, Columbia University, New York, Technical Report CUCS-006-96, 1996.
42. Veeman C.J., Reinders M.J.T. The nearest subclass classifier: a compromise between the nearest mean and nearest neighbor classifier. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27(9):1417-1429.
43. Wright J., Yang A.Y., Ganesh A., Sastry S.S., Ma Y. Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(2):210-227.
44. Lee D.D., Seung H.S. Learning the parts of objects by nonnegative matrix factorization. Nature 1999, 401:788-791.
45. Bao B.K., Liu G., Hong R., Yan S., Xu C. General subspace learning with corrupted training data via graph embedding. IEEE Trans. Image Process. 2013, 22(11):4380-4393.