Semi-supervised learning with nuclear norm regularization

Pattern Recognition

Volumn 46, Issue 8, 2013, Pages 2323-2336

  Shang, Fanhua ^a   Jiao, L C ^a   Liu, Yuanyuan ^a   Tong, Hanghang ^b  

^a XIDIAN UNIVERSITY   (China)

^b City College of New York   (United States)

Author keywords

Graph Laplacian; Low rank kernel learning; Nuclear norm regularization; Pairwise constraints; Semi supervised learning (SSL)

Indexed keywords

GRAPH LAPLACIAN; KERNEL LEARNING; NUCLEAR NORM REGULARIZATIONS; PAIRWISE CONSTRAINTS; SEMI-SUPERVISED LEARNING (SSL);

ALGORITHMS; LAPLACE TRANSFORMS; VIRTUAL REALITY;

SUPERVISED LEARNING;

EID: 84875709468     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.01.009     Document Type: Article

References (59)

1. O. Chapelle, B. Schölkopf, and A. Zien Semi-supervised Learning 2006 The MIT Press Cambridge, MA
2. X. Zhu, Semi-supervised learning literature survey, Computer Sciences Technical Report 1530, University of Wisconsin, Madison, 2008.
3. X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using Gaussian fields and harmonic functions, in: Proceedings of 20th International Conference on Machine Learning, 2003, pp. 912-919.
4. D. Zhou, O. Bousquet, T. Lal, J. Weston, B. Schölkopf, Learning with local and global consistency, in: Advances in Neural Information Processing Systems, 2004, pp. 321-328.
5. M. Belkin, P. Niyogi, and V. Sindhwani Manifold regularization: a geometric framework for learning from labeled and unlabeled examples Journal of Machine Learning Research 7 2006 2399 2434
6. S. Melacci, and M. Belkin Laplacian support vector machines trained in the primal Journal of Machine Learning Research 12 2011 1149 1184
7. Z. Li, J. Liu, X. Tang, Pairwise constraint propagation by semidefinite programming for semi-supervised classification, in: Proceedings of 25th International Conference on Machine Learning, 2008, pp. 576-583.
8. R. Yan, J. Zhang, J. Yang, and A. Hauptmann A discriminative learning framework with pairwise constraints for video object classification IEEE Transactions on Pattern Analysis and Machine Intelligence 28 4 2006 578 593
9. A. Goldberg, X. Zhu, S. Wright, Dissimilarity in graph-based semi-supervised classification, in: Proceedings of 16th International Conference on Artificial Intelligence and Statistics, 2007, pp. 155-162.
10. W. Tong, R. Jin, Semi-supervised learning by mixed label propagation, in: Proceedings of 22nd International Conference on Artificial Intelligence, 2007, pp. 651-656.
11. A. Erdem, and M. Pelillo Graph transduction as a non-cooperative game Neural Computation 24 3 2012 700 723
12. K. Wagstaff, C. Cardie, Clustering with instance-level constraints, in: Proceedings of 17th International Conference on Machine Learning, 2000, pp. 1103-1110.
13. K. Wagstaff, C. Cardie, S. Rogers, S. Schroedl, Constrained K-means clustering with background knowledge, in: Proceedings of 18th International Conference on Machine Learning, 2001, pp. 577-584.
14. D. Klein, S. Kamvar, C. Manning, From instance-level constraints to space-level constraints: making the most of prior knowledge in data clustering, in: Proceedings of 19th International Conference on Machine Learning, 2002, pp. 307-314.
15. S. Kamvar, D. Klein, C. Manning, Spectral learning, in: Proceedings of 18th International Joint Conference on Artificial Intelligence, 2003, pp. 561-566.
16. S. Basu, M. Bilenko, R. Mooney, A probabilistic framework for semi-supervised clustering, in: Proceedings of 10th ACM International Conference on Knowledge Discovery and Data Mining, 2004, pp. 59-68.
17. B. Kulis, S. Basu, I. Dhillon, R. Mooney, Semi-supervised graph clustering: a kernel approach, in: Proceedings of 22nd International Conference on Machine Learning, 2005, pp. 457-464.
18. Z. Li, J. Liu, X. Tang, Constrained clustering via spectral regularization, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 421-428.
19. E. Xing, A. Ng, M. Jordan, S. Russell, Distance metric learning, with application to clustering with side-information, in: Advances in Neural Information Processing Systems, 2003, pp. 505-512.
20. M. Bilenko, S. Basu, R. Mooney, Integrating constraints and metric learning in semi-supervised clustering, in: Proceedings of 21st International Conference on Machine Learning, 2004, pp. 81-88.
21. J. Davis, B. Kulis, P. Jain, S. Sra, I. Dhillon, Information theoretic metric learning, in: Proceedings of 24th International Conference on Machine Learning, pp. 209-216, 2007.
22. T. Joachims, Transductive inference for text classification using support vector machines, in: Proceedings of 16th International Conference on Machine Learning, 1999, pp. 200-209.
23. O. Chapelle, A. Zien, Semi-supervised classification by low density separation, in: Proceedings of 10th International Conference on Artificial Intelligence and Statistics, 2005, pp. 57-64.
24. L. Xu, D. Schuurmans, Unsupervised and semisupervised multi-class support vector machines, in: Proceedings of 20th AAAI Conference on Artificial Intelligence, 2005, pp. 904-910.
25. Z. Xu, R. Jin, J. Zhu, I. King, M.R. Lyu, Efficient convex relaxation for transductive support vector machine, in: Advances in Neural Information Processing Systems, 2008, pp. 1641-1648.
26. J. Zhuang, I. Tsang, and S.C.H. Hoi A family of simple non-parametric kernel learning algorithms Journal of Machine Learning Research 12 2011 1313 1347
27. S. Hoi, M. Lyu, E. Chang, Learning the unified kernel machines for classification, in: Proceedings of 12th ACM International Conference on Knowledge Discovery and Data Mining, 2006, pp. 187-196.
28. X. Zhu, J. Kandola, Z. Ghahramani, J. Lafferty, Nonparametric transforms of graph kernels for semi-supervised learning, in: Advances in Neural Information Processing Systems, 2005, pp. 1641-1648.
29. S. Hoi, R. Jin, M. Lyu, Learning nonparametric kernel matrices from pairwise constraints, in: Proceedings of 24th International Conference on Machine Learning, 2007, pp. 361-368.
30. W. Liu, B. Qian, J. Cui, J. Liu, Spectral kernel learning for semi-supervised classification, in: Proceedings of 21th Joint International Conference on Artificial Intelligence, 2009, pp. 1150-1155.
31. E. Hu, S. Chen, D. Zhang, and X. Yin Semisupervised kernel matrix learning by kernel propagation IEEE Transactions on Neural Networks 21 11 2010 1831 1841
32. X.-M. Wu, A. So, Z. Li, S. Li, Fast graph Laplacian regularized kernel learning via semidefinite-quadratic-linear programming, in: Advances in Neural Information Processing Systems, 2009, pp. 1964-1972.
33. F. Shang, L.C. Jiao, F. Wang, Semi-supervised learning with mixed knowledge information, in: Proceedings of 18th ACM International Conference on Knowledge Discovery and Data Mining, 2012, pp. 732-740.
34. L. Zelnik-Manor, P. Perona, Self-tuning spectral clustering, in: Advances in Neural Information Processing Systems, 2004, pp. 1601-1608.
35. F. Shang, Y. Liu, F. Wang, Learning spectral embedding for semi-supervised clustering, in: Proceedings of 11th IEEE International Conference on Data Mining, 2011, pp. 597-606.
36. F. Wang, and C. Zhang Label propagation through linear neighborhoods IEEE Transactions on Knowledge and Data Engineering 20 1 2008 55 67
37. J. Cai, E.J. Candès, and Z. Shen A singular value thresholding algorithm for matrix completion SIAM Journal on Optimization 20 4 2010 1956 1982
38. S. Ma, D. Goldfarb, and L. Chen Fixed point and Bregman iterative methods for matrix rank minimization Mathematical Programming (Series A) 128 1 2011 321 353
39. Z. Lin, M. Chen, L. Wu, The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices, Technical Report UILU-ENG-09-2215, Univ. Illinois, Urbana-Champaign, October 2009.
40. E.J. Candès, and B. Recht Exact matrix completion via convex optimization Foundations of Computational Mathematics 9 6 2009 717 772
41. B. Recht, M. Fazel, and P. Parrilo Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization SIAM Review 52 3 2010 471 501
42. J.T. Kwok, I.W. Tsang, Learning with idealized kernels, in: Proceedings of 24th International Conference on Machine Learning, 2003, pp. 400-407.
43. K.Q. Weinberger, F. Sha, Q. Zhu, L.K. Saul, Graph Laplacian regularization for large-scale semidefinite programming, in: Advances in Neural Information Processing Systems, 2007, pp. 1489-1496.
44. F. Shang, L.C. Jiao, Y. Liu, F. Wang, Learning spectral embedding via iterative eigenvalue thresholding, in: Proceedings of 21st ACM International Conference on Information and Knowledge Management, 2012, pp. 1507-1511.
45. Z. Liu, and L. Vandenberghe Interior-point method for nuclear norm approximation with application to system identification SIAM Journal on Matrix Analysis and Applications 31 3 2010 1235 1256
46. Y. Ni, J. Sun, X. Yuan, S. Yan, L. Cheong, Robust low-rank subspace segmentation with semidefinite guarantees, in: Proceedings of 10th IEEE International Conference on Data Mining, 2010, pp. 1179-1188.
47. A.B. Goldberg, X. Zhu, B. Recht, J. Xu, R. Nowak, Transduction with matrix completion: three birds with one stone, in: Advances in Neural Information Processing Systems, 2010, pp. 757-765.
48. Y. Ma, L. Zhi, The minimum-rank gram matrix completion via modified fixed point continuation method, in: Proceedings of 36th International Symposium on Symbolic and Algebraic Computation, 2011, pp. 241-248.
49. J. Barzilai, and J. Borwein Two-point step size gradient methods IMA Journal of Numerical Analysis 8 1988 141 148
50. G.H. Golub, and C.F.V. Loan Matrix computations third ed. 1996 Johns Hopkins University Press
51. O. Delalleau, Y. Bengio, N. Roux, Efficient non-parametric function induction in semi-supervised learning, in: Proceedings of 10th International Conference on Artificial Intelligence and Statistics, 2005, pp. 96-103.
52. C. Chang, C. Lin, LIBSVM: A library for support vector machines, 2001. Available from 〈http://www.csie.ntu.edu.tw/~cjlin/libsvm〉.
53. R. Souvenir, R. Pless, Manifold clustering, in: Proceedings of 10th IEEE International Conference on Computer Vision, 2005, pp. 648-654.
54. Y. LeCun, C. Cortes, The MNIST database of handwritten digits, 2009. Available from: 〈http://yann.lecun.com/exdb/mnist/〉.
55. S.A. Nene, S.K. Nayar, J. Murase, Columbia object image library (COIL-20), Technical Report CUCS-005-96, Columbia University, 1996.
56. R. Vidal, Y. Ma, J. Piazzi, A new GPCA algorithm for clustering subspaces by fitting, differentiating and dividing polynomials, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 510-517.
57. A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman From few to many: illumination cone models for face recognition under variable lighting and pose IEEE Transactions on Pattern Analysis and Machine Intelligence 23 6 2001 643 660
58. M. Szummer, T. Jaakkola, Partially labeled classification with Markov random walks, in: Advances in Neural Information Processing Systems, 2002, pp. 945-952.
59. F. Shang, L.C. Jiao, and Y. Liu Integrating spectral kernel learning and constraints in semi-supervised classification Neural Processing Letters 36 2 2012 101 115