Semisupervised multicategory classification with imperfect model

IEEE Transactions on Neural Networks

Volumn 20, Issue 10, 2009, Pages 1594-1603

  Chen, Hong ^a,b   Li, Luoqing ^a  

^a HUBEI UNIVERSITY   (China)

^b HUAZHONG AGRICULTURAL UNIVERSITY   (China)

Author keywords

Density estimation; Generalization error; Multicategory classification; Semisupervised learning

Indexed keywords

DENSITY ESTIMATION; EMPIRICAL PERFORMANCE; FAST CONVERGENCE RATE; GENERALIZATION ERROR; GENERALIZATION ERROR BOUNDS; MIXTURE DENSITY MODELS; MIXTURE DISTRIBUTIONS; MULTICATEGORY CLASSIFICATION; SEMI-SUPERVISED; SEMI-SUPERVISED METHOD; SEMISUPERVISED LEARNING; TRAINING DATA; UNLABELED DATA;

LEARNING SYSTEMS;

PROBABILITY DISTRIBUTIONS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 70350335376     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2027320     Document Type: Article

References (31)

1. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 68, pp. 337-404, 1950.
2. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularizaion: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, pp. 2399-2434, 2006.
3. M. Belkin and P. Niyogi, "Semi-supervised learning on Riemannian manifolds," Mach. Learn., vol. 56, pp. 209-239, 2004.
4. V. Castelli and T. M. Cover, "On the exponential value of labeled samples," Pattern Recognit. Lett., vol. 16, pp. 105-111, 1995.
5. V. Castelli and T. M. Cover, "The relative values of labeled and unlabeled samples in pattern recognition with an unknown mixing parameters," IEEE Trans. Inf. Theory, vol. 42, no. 6, pp. 2102-2117, Nov. 1996.
6. O. Chapelle, B. Schölkopf, and A. Zien, Semi-Supervised Learning Cambridge, MA: MIT Press, 2006.
7. H. Chen and L. Q. Li, "Error bounds of semi-supervised multi-graph regularized classifiers," Inf. Sci., vol. 179, pp. 1960-1969, 2009.
8. D. R. Chen and T. Sun, "Consistency of multiclass empirical risk minimization methods based on convex loss," J. Mach. Learn. Res., vol. 7, pp. 2435-2447, 2006.
9. D. R. Chen, Q.Wu, Y. Ying, and D. X. Zhou, "Support vector machine soft margin classifiers: Error analysis," J. Mach. Learn. Res., vol. 5, pp. 1143-1175, 2004.
10. D. R. Chen and D. H. Xiang, "The consistency of multicategory support vector machines," Adv. Comput. Math., vol. 24, pp. 155-169, 2006.
11. C. K. Chow, "On optimum error and reject trade-off," IEEE Trans. Inf. Theory, vol. IT-16, no. 1, pp. 41-46, Jan. 1970.
12. F. Cucker and S. Smale, "On the mathematical foundations of learning," Bull. Amer. Math. Soc., vol. 39, pp. 1-49, 2002.
13. F. Cucker and D. X. Zhou, Learning Theory: An Approximation Theory Viewpoint. Cambridge, U.K.: Cambridge Univ. Press, 2007.
14. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
15. R. Johnson and T. Zhang, "On the effectiveness of Laplacian normalization for graph semi-supervised learning," J. Mach. Learn. Res., vol. 8, pp. 1489-1517, 2007.
16. R. Johnson and T. Zhang, "Graph-based semi-supervised learning and spectral kernel design," IEEE Trans. Inf. Theory, vol. 54, no. 1, pp. 275-288, Jan. 2008.
17. Y. Lee, Y. Lin, and G. Wahba, "Multicategory support vector machines, theory, and application to the classification of microarray data and satellite randiance data," J. Amer. Statist. Assoc., vol. 99, pp. 67-81, 2004.
18. H. Narayanan, M. Belkin, and P. Niyogi, "On the relation between low density separation spectral clustering and graph cuts," in Advances in Neural Information Processing Systems 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge, MA:MIT Press, 2006, pp. 1025-1032.
19. P. Niyogi, "Manifold regularization and semi-supervised learning: Some theoretical analyses," Comput. Sci. Dept., Univ. Chicago, Chicago, IL, Tech. Rep. TR-2008-01, 2008.
20. W. Polonik, "Measuring mass concentrations and estimating density contour clusters-an excess mass approach," Ann. Statist., vol. 23, pp. 855-881, 1995.
21. J. Ratsaby and S. S. Venkatesh, "Learning from a mixture of labeled and unlabeled examples with parametric side information," in Proc. 8th Annu. Conf. Comput. Learn. Theory, Santa Cruz, CA, 1995, pp. 412-417.
22. P. Rigollet, "Generalization error bounds in semi-supervised classification under the cluster assumption," J. Mach. Learn. Res. vol. 8, pp. 1369-1392, 2007.
23. K. Sinha and M. Belkin, "The value of labeled and unlabeled examples when the model is imperfect," in Advances in Neural Information Processing Systems 20, J. C. Platt, D. Koller, Y. Singer, and S. Roweis, Eds. Cambridge, MA: MIT Press, 2008, pp. 1361-1368.
24. A. Tewari and P. L. Bartlett, "On the consistency of multiclass classification methods," J. Mach. Learn. Res., vol. 8, pp. 1007-1025, 2007.
25. A. B. Tsybakov, "Optimal aggregation of classifiers in statistical learning," Ann. Statist., vol. 32, pp. 135-166, 2004.
26. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
27. T. Zhang and F. J. Oles, "A probability analysis on the value of unlabeled data for classification problems," in Proc. 17th Int. Conf. Mach. Learn., San Francisco, CA, 2000, pp. 1191-1198.
28. T. Zhang, "Statistical analysis of some multiclass large margin classification method," J. Mach. Learn. Res., vol. 5, pp. 1225-1251, 2004.
29. D. X. Zhou, "The covering number in learning theory," J. Complex. vol. 18, pp. 739-767, 2002.
30. D. X. Zhou, "Capacity of reproducing kernel spaces in learning theory," IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1743-1752, Jul. 2003.
31. X. Zhu, "Semi-supervised learning literature survey," Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, Tech. Rep. 1530, 2005.