Learning balanced and unbalanced graphs via low-rank coding

IEEE Transactions on Knowledge and Data Engineering

Volumn 27, Issue 5, 2015, Pages 1274-1287

  Li, Sheng ^a   Fu, Yun ^a  

^a Northeastern University   (United States)

Author keywords

b matching; data clustering; Low rank learning; semi supervised classification; similarity metric

Indexed keywords

CLUSTERING ALGORITHMS; CODES (SYMBOLS); GRAPHIC METHODS; IMAGE MATCHING; LAGRANGE MULTIPLIERS; NEAREST NEIGHBOR SEARCH; SUPERVISED LEARNING;

B-MATCHING; DATA CLUSTERING; RANK LEARNING; SEMI-SUPERVISED CLASSIFICATION; SIMILARITY METRICS;

GRAPH THEORY;

EID: 84926652192     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2014.2365793     Document Type: Article

References (55)

1. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
2. R. Anand and C. K. Reddy, "Graph-based clustering with constraints," in Proc. Pacific-Asia Conf. Knowl. Discovery Data Mining, 2011, pp. 51-62.
3. F. Wang, P. Li, A. C. König, and M. Wan, "Improving clustering by learning a bi-stochastic data similarity matrix," Knowl. Inf. Syst., vol. 32, no. 2, pp. 351-382, 2012.
4. J. Liu, C. Wang, M. Danilevsky, and J. Han, "Large-scale spectral clustering on graphs," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1486-1492.
5. X. Zhu, "Semi-supervised learning," Encyclopedia of Machine Learning, C. Sammut and G. I. Webb (Eds.), Springer, pp. 892-897, 2010.
6. M. Culp and G. Michailidis, "Graph-based semisupervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 1, pp. 174-179, Jan. 2008.
7. O. Chapelle, B. Schlkopf, and A. Zien, Semi-Supervised Learning, Cambridge, MA, USA: MIT Press, 2006.
8. B. Kveton, M. Valko, A. Rahimi, and L. Huang, "Semi-supervised learning with max-margin graph cuts," J. Mach. Learn. Res. - Proc. Track, vol. 9, pp. 421-428, 2010.
9. W. Liu, J. Wang, and S.-F. Chang, "Robust and scalable graphbased semisupervised learning," Proc. IEEE, vol. 100, no. 9, pp. 2624-2638, Sep. 2012.
10. X. Zhu, A. B. Goldberg, and T. Khot, "Some new directions in graph-based semi-supervised learning," in Proc. IEEE Int. Conf. Multimedia Expo., 2009, pp. 1504-1507.
11. T. Iwata and K. Duh, "Bidirectional semi-supervised learning with graphs," in Proc. Eur. Conf. Mach. Learn. Principles Practices Knowl. Discovery Databases, 2012, pp. 293-306.
12. K. Zhang, Q. Wang, L. Lan, Y. Sun, and I. Marsic, "Sparse semisupervised learning on low-rank kernel," Neurocomputing, vol. 129, pp. 265-272, 2014.
13. X. Zhu, Z. Ghahramani, and J. D. Lafferty, "Semi-supervised learning using gaussian fields and harmonic functions," in Proc. Int. Conf. Mach. Learn., 2003, pp. 912-919.
14. D. Zhou, O. Bousquet, T. N. Lal, J. Weston, and B. Schölkopf, "Learning with local and global consistency," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 321-328.
15. F. Wang and C. Zhang, "Label propagation through linear neighborhoods," IEEE Trans. Knowl. Data Eng., vol. 20, no. 1, pp. 55-67, Jan. 2008.
16. J. He, J. G. Carbonell, and Y. Liu, "Graph-based semi-supervised learning as a generative model," in Proc. Int. Joint Conf. Artif. Intell., 2007, pp. 2492-2497.
17. A. B. Goldberg, X. Zhu, and S. J. Wright, "Dissimilarity in graphbased semi-supervised classification," J. Mach. Learn. Res. - Proc. Track, vol. 2, pp. 155-162, 2007.
18. D. Cai, X. He, and J. Han, "Semi-supervised discriminant analysis," in Proc. Int. Conf. Comput. Vis., 2007, pp. 1-7.
19. P. N. Bellhumeur, J. P. Hespanha, and D. J. Kriegeman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
20. B. Ni, S. Yan, and A. A. Kassim, "Learning a propagable graph for semisupervised learning: Classification and regression," IEEE Trans. Knowl. Data Eng., vol. 24, no. 1, pp. 114-126, Jan. 2012.
21. M. Sokol, K. Avrachenkov, P. Gonçalves, and A. Mishenin, "Generalized optimization framework for graph-based semisupervised learning," in Proc. SIAM Int. Conf. Data Mining, 2012, pp. 966-974.
22. J. Wang and Y. Xia, "Fast graph construction using auction algorithm," in Proc. Conf. Uncertainity Artif. Intell., 2012, pp. 873-882.
23. C. A. R. de Sousa, S. O. Rezende, and G. E. A. P. A. Batista, "Influence of graph construction on semi-supervised learning," in Proc. Eur. Conf. Mach. Learn. Principles Practices Knowl. Discovery Databases, 2013, pp. 160-175.
24. T. Jebara, J. Wang, and S.-F. Chang, "Graph construction and b-matching for semi-supervised learning," in Proc. Int. Conf. Mach. Learn., 2009, pp. 441-448.
25. K. Chen and S. Wang, "Regularized boost for semi-supervised learning," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 281-288.
26. Z. Zhang, T. W. S. Chow, and M.-B. Zhao, "Trace ratio optimization-based semi-supervised nonlinear dimensionality reduction for marginal manifold visualization," IEEE Trans. Knowl. Data Eng., vol. 25, no. 5, pp. 1148-1161, May 2013.
27. G. Liu, Z. Lin, and Y. Yu, "Robust subspace segmentation by lowrank representation," in Proc. Int. Conf. Mach. Learn., 2010, pp. 663-670.
28. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
29. S. Li and Y. Fu, "Low-rank coding with b-matching constraint for semi-supervised classification," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1472-1478.
30. M.-B. Zhao, Z. Zhang, T. W. S. Chow, and B. Li, "A general soft label based linear discriminant analysis for semi-supervised dimensionality reduction," Neural Netw., vol. 55, pp. 83-97, 2014.
31. Z. Lin, M. Chen, and Y. Ma, "The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrix," Univ. of Illinois at Urbana-Champaign, Champaign, IL, USA, Tech. Rep. UILU-ENG-09-2215, 2009.
32. Z. Lin, R. Liu, and Z. Su, "Linearized alternating direction method with adaptive penalty for low-rank representation," in Proc. Adv. Inf. Process. Syst., 2011, pp. 612-620.
33. S. Wang, D. Liu, and Z. Zhang, "Nonconvex relaxation approaches to robust matrix recovery," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1764-1770.
34. A. Talwalkar, L. W. Mackey, Y. Mu, S.-F. Chang, and M. I. Jordan, "Distributed low-rank subspace segmentation," in Proc. Int. Conf. Comput. Vis., 2013, pp. 3543-3550.
35. S. Yan and H. Wang, "Semi-supervised learning by sparse representation," in Proc. SIAM Int. Conf. Data Mining, 2009, pp. 792-801.
36. B. Huang and T. Jebara, "Fast b-matching via sufficient selection belief propagation," J. Mach. Learn. Res. - Proc. Track, vol. 15, pp. 361-369, 2011.
37. J. Wright, A. Y. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
38. R. He, W. Zheng, B. Hu, and X. Kong, "Nonnegative sparse coding for discriminative semi-supervised learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 2849-2856.
39. F. Nie, H. Wang, H. Huang, and C. H. Q. Ding, "Unsupervised and semi-supervised learning via l1-norm graph," in Proc. Int. Conf. Comput. Vis., 2011, pp. 2268-2273.
40. T. Zhang, R. Ji, W. Liu, D. Tao, and G. Hua, "Semi-supervised learning with manifold fitted graphs," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1896-1902.
41. H. Cheng, Z. Liu, and J. Yang, "Sparsity induced similarity measure for label propagation," in Proc. Int. Conf. Comput. Vis., 2009, pp. 317-324.
42. F. Bach, "Consistency of trace norm minimization," J. Mach. Learn. Res., vol. 9, pp. 1019-1048, 2008.
43. E. J. Candés, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?" J. ACM, vol. 58, no. 3, p. 11, 2011.
44. L. Li, S. Li, and Y. Fu, "Discriminative dictionary learning with low-rank regularization for face recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., 2013, pp. 1-6.
45. S. Li and Y. Fu, "Robust subspace discovery through supervised low-rank constraints," in Proc. SIAM Int. Conf. Data Mining, 2014, pp. 163-171.
46. S. Li, M. Shao, and Y. Fu, "Locality linear fitting one-class SVM with low-rank constraints for outlier detection," in Proc. Int. Joint Conf. Neural Netw., 2014, pp. 676-683.
47. L. Zhuang, H. Gao, Z. Lin, Y. Ma, X. Zhang, and N. Yu, "Nonnegative low rank and sparse graph for semi-supervised learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2328-2335.
48. F. Shang, L. Jiao, and F. Wang, "Semi-supervised learning with mixed knowledge information," in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2012, pp. 732-740.
49. F. Shang, L. Jiao, Y. Liu, and F. Wang, "Learning spectral embedding via iterative eigenvalue thresholding," in Proc. ACM Int. Conf. Inf. Knowl. Manage., 2012, pp. 1507-1511.
50. F. Shang, L. Jiao, Y. Liu, and H. Tong, "Semi-supervised learning with nuclear norm regularization," Pattern Recognit., vol. 46, no. 8, pp. 2323-2336, 2013.
51. M. Zhao, L. Jiao, J. Feng, and T. Liu, "A simplified low rank and sparse graph for semi-supervised learning," Neurocomputing, vol. 140, pp. 84-96, 2014.
52. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
53. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
54. F. Samaria and A. Harter, "Parameterisation of a stochastic model for human face identification," in Proc. 2nd IEEE Workshop Appl. Comput. Vis., 1994, pp. 138-142.
55. J. Hull, "A database for handwritten text recognition research," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 5, pp. 550-554, May 1994.