Large margin semi-supervised learning

Journal of Machine Learning Research

Volumn 8, Issue , 2007, Pages 1867-1891

  Wang, Junhui ^a   Shen, Xiaotong ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Generalization; Grouping; Sequential quadratic programming; Support vectors

Indexed keywords

DATA ACQUISITION; DIFFERENCE EQUATIONS; ERROR ANALYSIS; ESTIMATION; QUADRATIC PROGRAMMING; TUNING;

DIFFERENCE CONVEX PROGRAMMING; LARGE MARGIN SEMI-SUPERVISED LEARNING; SEQUENTIAL QUADRATIC PROGRAMMING; TUNING REGULARIZERS;

LEARNING SYSTEMS;

EID: 35548968410     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (40)

1. R. A. Adams. Sobolev Spaces. Academic Press, New York, 1975.
2. M. Amini, and P. Gallinari. Semi-supervised learning with an explicit label-error model for misclassified data. In IJCAl 2003.
3. L. An and P. Tao. Solving a class of linearly constrained indefinite quadratic problems by D.C. algorithms. J. of Global Optimization, 11:253-285, 1997.
4. R. Ando and T. Zhang. A framework for learning predictive structures from multiple tasks and unlabeled data. Technical Report RC23462, IBM T.J. Watson Research Center, 2004.
5. M. Balcan, A. Blum, P. Choi, J. Lafferty, B. Pantano, M. Rwebangira and X. Zhu. Person identification in webcam images: an application of semi-supervised learning. In ICML 2005.
6. P. L. Bartlett, M. I. Jordan and J. D. McAuliffe. Convexity, classification, and risk bounds. J. Amer. Statist. Assoc., 19:138-156, 2006.
7. M. Belkin, P. Niyogi and V. Sindhwani. Manifold Regularization: A Geometric Framework for Learning From Examples. Technical Report, Univ. of Chicago, Department of Computer Science, TR-2004-06, 2004.
8. C. L. Blake and C. J. Merz. UCI repository of machine learning databases [http://www.ics.ci.edu/~mlearn/MLRepository.html]. University of California, Irvine, Department of Information and Computer Science, 1998.
9. A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In Proceedings of the Eleventh Annual Conference on Computational Learning Theory, 1998.
10. M. Collins and Y. Singer. Unsupervised models for named entity classification. In Empirical Methods in Natural Language Processing and Very Large Corpora, pages 100-110, 1999.
11. C. Cortes and V. Vapnik. Support vector networks. Machine Learning, 20:273-297, 1995.
12. F. G. Cozman, I. Cohen and M. C. Cirelo. Semi-supervised learning of mixture models and Bayesian networks. In ICML 2003.
13. B. Efron. The estimation of prediction error: Covariance penalties and cross-validation. J. Amer. Statist. Assoc., 99:619-632, 2004.
14. C. Gu. Multidimension smoothing with splines. In M.G. Schimek, editor, Smoothing and Regression: Approaches, Computation and Application, 2000.
15. T. Hastie, S. Rosset, R. Tibshirani and J. Zhu. The entire regularization path for the support vector machine. J. of Machine Learning Research, 5: 1391-1415, 2004.
16. T. Joachims. Transductive inference for text classification using support vector machines. In ICML 1999.
17. Y. Lin. Support vector machines and the Bayes rule in classification. Data Mining and Knowledge Discovery, 6:259-275, 2002.
18. Y. Lin and L. D. Brown. Statistical properties of the method of regularization with periodic Gaussian reproducing kernel. Ann. Statist., 32:1723-1743, 2004.
19. S. Liu, X. Shen and W. Wong. Computational development of ψ-learning. In SIAM 2005 International Data Mining Conference, pages 1-12, 2005.
20. Y. Liu and X. Shen. Multicategory ψ-learning. J. Amer. Statist. Assoc., 101:500-509, 2006.
21. P. Mason, L. Baxter, J. Bartlett and M. Frean. Boosting algorithms as gradient descent. In Advances in Neural Information Processing Systems 12, pages 512-518. The MIT Press, 2000.
22. K. Nigam, A. McCallum, S. Thrun and T. Mitchell. Text classification from labeled and unlabeled documents using EM. In AAAI 1998.
23. B. Schölkopf, A. Smola, R. Williamson and P. Bartlett. New support vector algorithms. Neural Computation, 12:1207-1245, 2000.
24. X. Shen and W. Wong. Convergence rate of sieve estimates. Ann. Statist., 22:580-615, 1994.
25. X. Shen. On the method of penalization. Statist. Silica, 8:337-357, 1998.
26. X. Shen and H. C. Huang. Optimal model assessment, selection and combination. J. Amen Statist. Assoc., 101:554-568, 2006.
27. X. Shen, G. C. Tseng, X. Zhang and W. Wong. On psi-learning. J. Amer. Statist. Assoc., 98:724-734, 2003.
28. X. Shen and L. Wang. Discussion of 2004 IMS Medallion Lecture: "Local Rademacher complexities and oracle inequalities in risk minimization". Ann. Statist., in press.
29. I. Steinwart. On the influence of the kernel on the consistency of support vector machines. J. Machine Learning Research, 2:67-93, 2001.
30. M. Szummer and T. Jaakkola. Information regularization with partially labeled data. In NIPS 2003.
31. S. Van De Geer. Hellinger-consistency of certain nonparametric maximum likelihood estimators. Ann. Statist., 21:14-44, 1993.
32. V. Vapnik. Statistical Learning Theory. Wiley, New York, 1998.
33. G. Wahba. Spline models for observational data. Series in Applied Mathematics, Vol. 59, SIAM, Philadelphia, 1990.
34. J. Wang and X. Shen. Estimation of generalization error: random and fixed inputs. Statist. Sinica, 16:569-588, 2006.
35. J. Wang, X. Shen and W. Pan. On transductive support vector machines. In Proc of the Snowbird Machine Learning Conference, in press.
36. T. Zhang and F. Oies. A probability analysis on the value of unlabeled data for classification problems. In ICML 2000.
37. D. Zhou. The covering number in learning theory. J. of Complexity, 18:739-767, 2002.
38. J. Zhu and T. Hastie. Kernel logistic regression and the import vector machine. J. Comp. Graph. Statist., 14:185-205, 2005.
39. X. Zhu, Z. Ghahramani and J. Lafferty. Semi-supervised learning using gaussian fields and harmonic functions. In ICML 2003.
40. X. Zhu and J. Lafferty. Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning. In ICML 2005.