Learning a nonnegative sparse graph for linear regression

IEEE Transactions on Image Processing

Volumn 24, Issue 9, 2015, Pages 2760-2771

  Fang, Xiaozhao ^a   Xu, Yong ^a,b   Li, Xuelong ^c   Lai, Zhihui ^a,d   Wong, Wai Keung ^e  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

^b Key Laboratory of Network Oriented Intelligent Computation   (China)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

^d SHENZHEN UNIVERSITY   (China)

^e HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Graph learning; label propagation; linear regression,; semi supervised classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); FORECASTING; GRAPHIC METHODS; LINEAR REGRESSION; SUPERVISED LEARNING;

CLASSIFICATION ACCURACY; GRAPH LEARNING; GRAPH-CONSTRUCTION METHOD; LABEL PROPAGATION; LINEAR REGRESSION METHODS; OPTIMIZATION PROBLEMS; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED CLASSIFICATION;

GRAPH THEORY;

EID: 84930959938     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2425545     Document Type: Article

References (53)

1. S.-J. Wang, S. Yan, J. Yang, C.-G. Zhou, and X. Fu, "A general exponential framework for dimensionality reduction," IEEE Trans. Image Process., vol. 23, no. 2, pp. 920-930, Feb. 2014.
2. T. Zhou and D. Tao, "Double shrinking sparse dimension reduction," IEEE Trans. Image Process., vol. 22, no. 1, pp. 244-257, Jan. 2013.
3. F. Nie, D. Xu, X. Li, and S. Xiang, "Semisupervised dimensionality reduction and classification through virtual label regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 3, pp. 675-685, Jun. 2011.
4. D. Xu, S. Yan, S. Lin, T. S. Huang, and S.-F. Chang, "Enhancing bilinear subspace learning by element rearrangement," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1913-1920, Oct. 2009.
5. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008.
6. Z. Fan et al., "Modified principal component analysis: An integration of multiple similarity subspace models," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 8, pp. 1538-1552, Aug. 2014.
7. X. Li, Y. Pang, and Y. Yuan, "L1-norm-based 2DPCA," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1170-1175, Aug. 2010.
8. Z. Fan, Y. Xu, and D. Zhang, "Local linear discriminant analysis framework using sample neighbors," IEEE Trans. Neural Netw., vol. 22, no. 7, pp. 1119-1132, Jul. 2011.
9. D. Tao, L. Jin, Y. Wang, and X. Li, "Rank preserving discriminant analysis for human behavior recognition on wireless sensor networks," IEEE Trans. Ind. Informat., vol. 10, no. 1, pp. 813-823, Feb. 2014.
10. Y. Yang, D. Xu, F. Nie, S. Yan, and Y. Zhuang, "Image clustering using local discriminant models and global integration," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2761-2773, Oct. 2010.
11. F. Nie, S. Xiang, Y. Jia, and C. Zhang, "Semi-supervised orthogonal discriminant analysis via label propagation," Pattern Recognit., vol. 42, no. 11, pp. 2615-2627, Nov. 2009.
12. G. Guo, Y. Fu, C. R. Dyer, and T. S. Huang, "Image-based human age estimation by manifold learning and locally adjusted robust regression," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1178-1188, Jul. 2008.
13. B. Li, S. Yan, and A. Kassim, "Learning a propagable graph for semisupervised learning: Classification and regression," IEEE Trans. Knowl. Data Eng., vol. 24, no. 1, pp. 114-126, Jan. 2012.
14. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
15. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. NIPS, 2001, pp. 585-591.
16. X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang, "Face recognition using Laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
17. M. Wu, K. Yu, S. Yu, and B. Schölkopf, "Local learning projections," in Proc. ICML, 2007, pp. 1039-1046.
18. X. He, D. Cai, S. Yan, and H.-J. Zhang, "Neighborhood preserving embedding," in Proc. ICCV, Oct. 2005, pp. 1208-1213.
19. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
20. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
21. Y. Luo, D. Tao, B. Geng, C. Xu, and S. Maybank, "Shared feature extraction for semi-supervised image classification," in Proc. 19th ACM Int. Conf. Multimedia, 2011, pp. 1165-1168.
22. Y. Zhang and D.-Y. Yeung, "Semisupervised generalized discriminant analysis," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1207-1217, Aug. 2011.
23. X. Zhu, Semi-Supervised Learning Literature Survey. Madison, WI, USA: Univ. Wisconsin-Madison, 2007.
24. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. ICML, 1999, pp. 200-209.
25. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. Conf. Comput. Learn. Theory, 1998, pp. 92-100.
26. D. Cai, X. He, and J. Han, "Semi-supervised discriminant analysis," in Proc. ICCV, Oct. 2007, pp. 1-7.
27. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
28. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. NIPS, 2003, pp. 1-8.
29. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. ICML, 2003, pp. 912-919.
30. F. Nie, X. Wang, and H. Huang, "Clustering and projected clustering with adaptive neighbors," in Proc. KDD, 2014, pp. 977-986.
31. X. Fang, Y. Xu, X. Li, Z. Fan, H. Liu, and Y. Chen, "Locality and similarity preserving embedding for feature selection," Neurocomputing, vol. 128, pp. 304-315, Mar. 2014.
32. V. Sindhwani, P. Niyogi, M. Belkin, and S. Keerthi, "Linear manifold regularization for large scale semi-supervised learning," in Proc. ICML Workshop Learn. Partially Classified Training Data, 2005, pp. 1-4.
33. F. Nie, D. Xu, I. W. Tsang, and C. Zhang, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1921-1932, Jul. 2010.
34. B. Cheng, J. Yang, S. Yan, Y Fu, and T. S. Huang, "Learning with 11-graph for image analysis," IEEE Trans. Image Process., vol. 19, no. 4, pp. 858-866, Apr. 2010.
35. J. Wright, Y Ma, J. Mairal, G. Sapiro, T. S. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
36. L. Zhang et al., "Kernel sparse representation-based classifier," IEEE Trans. Signal Process., vol. 60, no. 4, pp. 1684-1695, Apr. 2012.
37. K. Yu, T. Zhang, and Y Gong, "Nonlinear learning using local coordinate coding," in Proc. NIPS, 2009, pp. 1-9.
38. D. Wang, S. C. H. Hoi, Y He, J. Zhu, T. Mei, and J. Luo, "Retrieval-based face annotation by weak label regularized local coordinate coding," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 3, pp. 550-563, Mar. 2014.
39. B. Liu, M. Wang, R. Hong, Z. Zha, and X.-S. Hua, "Joint learning of labels and distance metric," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 3, pp. 973-978, Jun. 2010.
40. J. Yang, D. Chu, L. Zhang, Y Xu, and J. Yang, "Sparse representation classifier steered discriminative projection with applications to face recognition," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 7, pp. 1023-1035, Jul. 2013.
41. J. Wang, J. Yang, K. Yu, F Lv, T. Huang, and Y Gong, "Locality-constrained linear coding for image classification," in Proc. CVPR, Jun. 2010, pp. 3360-3367.
42. Y Xu, D. Zhang, J. Yang, and J.-Y Yang, "A two-phase test sample sparse representation method for use with face recognition," IEEE Trans. Circuits Syst. Video Technol, vol. 21, no. 9, pp. 1255-1262, Sep. 2011.
43. 1-problems in compressive sensing," SIAM J. Sci. Comput, vol. 33, no. 1, pp. 250-278, 2011.
44. Y Zhang, J. Yang, and W Yin. (2011). YALL1: Your Algorithms for L1. [Online]. Available: http://yall1.blogs.rice.edu/
45. C. Hou, F. Nie, D. Yi, and Y. Wu, "Feature selection via joint embedding learning and sparse regression," in Proc. IJCAI, 2011, pp. 1-6.
46. Z. Ma, F. Nie, Y. Yang, J. R. R. Uijlings, N. Sebe, and A. G. Hauptmann, "Discriminating joint feature analysis for multimedia data understanding," IEEE Trans. Multimedia, vol. 14, no. 6, pp. 1662-1672, Dec. 2012.
47. F. Nie, Z. Zeng, I. W. Tsang, D. Xu, and C. Zhang, "Spectral embedded clustering: A framework for in-sample and out-of-sample spectral clustering," IEEE Trans. Neural Netw., vol. 22, no. 11, pp. 1796-1808, Nov. 2011.
48. D. Cai, X. He, and J. Han, "Spectral regression for efficient regularized subspace learning," in Proc. ICCV, Oct. 2007, pp. 1-8.
49. Y Xu et al., "Data uncertainty in face recognition," IEEE Trans. Cybern., vol. 44, no. 10, pp. 1950-1961, Oct. 2014.
50. [Online]. Available: http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html
51. S. Yan and H. Wang, "Semi-supervised learning by sparse representation," in Proc. SIAM Int. Conf. Data Mining (SDM), 2009, pp. 792-801.
52. R. He, W.-S. Zheng, B.-G. Hu, and X.-W. Kong, "Nonnegative sparse coding for discriminative semi-supervised learning," in Proc. CVPR, Jun. 2011, pp. 2849-2856.
53. W. Liu, D. Tao, and J. Liu, "Transductive component analysis," in Proc. ICDM, Dec. 2008, pp. 433-442.