Sparse semi-supervised learning on low-rank kernel

Neurocomputing

Volumn 129, Issue , 2014, Pages 265-272

  Zhang, Kai ^a   Wang, Qiaojun ^b   Lan, Liang ^c   Sun, Yu ^d   Marsic, Ivan ^b  

^a NEC LABORATORIES AMERICA   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c HUAWEI NOAH S ARK LAB   (China)

^d SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

Graph Laplacian; Low rank approximation; Manifold regularization; Regularized least squares; Semi supervised learning; Sparse regression

Indexed keywords

EID: 84893777179     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.09.033     Document Type: Article

References (38)

1. M. Belkin, P. Niyogi, Y. Sindhwani, Manifold regularization: a geometric framework for learning from labeled and unlabeled examples, J. Mach. Learn. Res. (2006) 2399-2434.
2. Bi J., Bennett K.P., Embrechts M., Breneman C.M., Song M., Guyon I., Elisseeff A. Dimensionality reduction via sparse support vector machines. J. Mach. Learn. Res. 2003, 3:1229-1243.
3. A. Blum, T. Mitchell, Combining labeled and unlabeled data with co-training, in: Annual Conference on Computational Learning Theory, 1998, pp. 92-100.
4. O. Chapelle, J. Weston, B. Schölkopf, Cluster kernels for semi-supervised learning, in: Neural Information Processing Systems, 2003, pp. 585-592.
5. Semi-Supervised Learning 2006, MIT Press. O. Chapelle, B. Schölkopf, A. Zien (Eds.).
6. R. Collobert, F. Sinz, J. Weston, L. Bottou, T. Joachims, Large scale transductive SVMs, J. Mach. Learn. Res. (2006) 1687-1712.
7. C. Cortes, M. Mohri, A. Rostamizadeh, Two-stage learning kernel algorithms, in: International Conference on Machine Learning, 2010.
8. O. Delalleau, Y. Bengio, N. Roux, Efficient non-parametric function induction in semisupervised learning, in: International Workshop on Artificial Intelligence and Statistics, 2005, pp. 96-103.
9. K. Deng, Y. Sun, P.G. Mehta, S.P. Meyn, An information-theoretic framework to aggregate a Markov chain, in: American Control Conference, 2009, pp 731-736.
10. Drineas P., Mahoney M.W. On the Nyström method for approximating a gram matrix for improved kernel-based learning. J. Mach. Learn. Res. 2005, 6:2153-2175.
11. C. Fowlkes, S. Belongie, F. Chung, J. Malik, Spectral grouping using the Nystrom method, IEEE Trans. Pattern Anal. Mach. Intell. (2004) 214-225.
12. C. Gustavo, T. Marsheva, D. Zhou, Semisupervised graph-based hyperspectral image classification, IEEE Trans. Geosci. Remote Sensing (2007) 3044-3054.
13. T. Joachims, Transductive inference for text classification using support vector machines, in: International Conference on Machine Learning, 1999, pp. 200-209.
14. Kim S., Koh K., Lustig M., Boyd S., Gorinevsky D. An interior-point method for large-scale l1-regularized least squares. IEEE J. Sel. Top. Signal Process. 2007, 1(4):606-617.
15. G. Lanckriet, N. Cristianini, P. Bartlett, L.E. Ghaoui, M. Jordan, Learning the kernel matrix with semidefinite programming, J. Mach. Learn. Res. (2004) 27-72.
16. Liu J., Ji S., Ye J. SLEP: Sparse Learning with Efficient Projections 2009, Arizona State University.
17. W. Liu, J. He, S. Chang, Large graph construction for scalable semi-supervised learning, in: International Conference on Machine Learning, 2010.
18. M. Mohri, A. Talwalkar, Sampling techniques for the Nyström method, J. Mach. Learn. Res. (2009) 304-311.
19. K. Sinha, M. Belkin, Semi-supervised learning using sparse eigenfunction, in: Neural Information Processing Systems, 2009, pp. 1687-1695.
20. A. Smola, R. Kondor, Kernels and regularization on graphs, in: Annual Conference on Learning Theory, 2003, pp. 144-158.
21. Sun Y., Metha P.G. The Kullback-Leibler rate pseudo-metric for comparing dynamical systems. IEEE Trans. Autom. Control 2010, 55(July (7)):1585-1598.
22. Sun S., Shawe-Taylor J. Sparse semi-supervised learning using conjugate functions. J. Mach. Learn. Res. 2010, 11:2423-2455.
23. S. Sun, Z. Hussain, J. Shawe-Taylor, Manifold-preserving graph reduction for sparse semi-supervised learning, Neurocomputing 124 (26) (2014) 13-21.
24. Tibshirani R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B 1996, 58:267-288.
25. Tsang I.W., Kwok J.T. Large-scale sparsified manifold regularization. Neural Inf. Process. Syst. 2006, 19:1401-1408.
26. C. Williams, M. Seeger, Using the Nyström method to speed up kernel machines, in: Neural Information Processing Systems, 2001, pp. 682-688.
27. C. Williams, M. Seeger, The effect of the input density distribution on kernel-based classifiers, in: Proceedings of the 17th International Conference on Machine Learning, 2000, pp. 1159-1166.
28. S. Yan, H. Wang, Semi-supervised learning by sparse representation, in: SIAM Conference on Data Mining, 2009, pp. 792-801.
29. Yang J., Zhang Y. Alternating direction algorithms for l1 problems in compressive sensing. SIAM J. Sci. Comput. 2011, 33(1):250-278.
30. K. Zhang, J.T. Kwok, Prototype vector machine for large scale semi-supervised learning, in: International Conference on Machine Learning, 2009, pp. 1233-1240.
31. K. Zhang, I. Tsang, J.T. Kwok, Improved Nyström low-rank approximation and error analysis, in: International Conference on Machine Learning, 2008, pp. 1232-1239.
32. K. Zhang, L. Lan, J. Liu, A. Rauber, F. Moerchen, Inductive kernel low-rank decomposition with priors, in: International Conference on Machine Learning, 2012, pp. 305-312.
33. K. Zhang, W. Zheng, Q. Wang, J.T. Kwok, Q. Yang, I. Marsic, Covariate shift in Hilbert space: a surrogate kernel approach, in: International Conference on Machine Learning, 2013, pp. 388-395.
34. Zhou C., Bousquet O., Lal T.N., Weston J., Schölkopf B. Learning with local and global consistency. Neural Inf. Process. Syst. 2004, 16:321-328.
35. X. Zhu. Semi-Supervised Learning Literature Survey, Technical Report, Department of Computer Science, University of Wisconsin-Madison, 2006.
36. X. Zhu, Z. Ghahramani, J. Lafferty, Semi-supervised learning using gaussian fields and harmonic functions, in: International Conference on Machine Learning, 2003, pp. 912-919.
37. Zhu X., Kandola J., Ghahbramani Z., Lafferty J. Nonparametric transforms of graph kernels for semi-supervised learning. Neural Inf. Process. Syst. 2005, 17:1641-1648.
38. Zou H. The adaptive LASSO and its oracle properties. J. Am. Stat. Assoc. 2006, 101(476):1418-1429.