Towards making unlabeled data never hurt

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 1, 2015, Pages 175-188

  Li, Yu Feng ^a   Zhou, Zhi Hua ^a  

^a NANJING UNIVERSITY   (China)

Author keywords

S3VMs; S4VMs; Safe; Semi supervised learning; Unlabeled data

Indexed keywords

LEARNING SYSTEMS; SEPARATORS; SUPPORT VECTOR MACHINES;

S3VMS; S4VMS; SAFE; SEMI- SUPERVISED LEARNING; UNLABELED DATA;

SUPERVISED LEARNING;

EID: 84916917798     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2299812     Document Type: Article

References (53)

1. M.F. Balcan and A. Blum, "A Discriminative Model for Semi-Supervised Learning," J. ACM, vol. 57, no. 3, article 19, 2010.
2. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples," J. Machine Learning Research, vol. 7, pp. 2399-2434, 2006.
3. S. Ben David, T. Lu, and D. Pál, "Does Unlabeled Data Provably Help? Worst-Case Analysis of the Sample Complexity of Semi-Supervised Learning," Proc. 21st Ann. Conf. Learning Theory, pp. 33-44, 2008.
4. K. Bennett and A. Demiriz, "Semi-Supervised Support Vector Machines," Proc. Advances in Neural Information Processing Systems, vol. 11, pp. 368-374, 1999.
5. J.C. Bezdek and R.J. Hathaway, "Convergence of Alternating Optimization," Neural, Parallel & Scientific Computations, vol. 11, no. 4, pp. 351-368, 2003.
6. T. De Bie and N. Cristianini, "Convex Methods for Transduction," Proc. Advances in Neural Information Processing Systems, vol. 16, pp. 73-80, 2004.
7. A. Blum and S. Chawla, "Learning from Labeled and Unlabeled Data Using Graph Mincuts," Proc. Eight Int'l Conf. Machine Learning, pp. 19-26, 2001.
8. A. Blum and T. Mitchell, "Combining Labeled and Unlabeled Data with Co-Training," Proc. Seventh Ann. Conf. Computational Learning Theory, 1998.
9. O. Chapelle, M. Chi, and A. Zien, "A Continuation Method for Semi-Supervised SVMs," Proc. 23rd Int'l Conf. Machine Learning, pp. 185-192, 2006.
10. Semi-Supervised Learning, O. Chapelle, B. Schölkopf, and A. Zien, eds., MIT Press, 2006.
11. O. Chapelle, V. Sindhwani, and S.S. Keerthi, "Optimization Techniques for Semi-Supervised Support Vector Machines," J. Machine Learning Research, vol. 9, pp. 203-233, 2008.
12. O. Chapelle and A. Zien, "Semi-Supervised Classification by Low Density Separation," Proc. 10th Int'l Workshop Artificial Intelligence and Statistics, pp. 57-64, 2005.
13. N. Chawla and G. Karakoulas, "Learning from Labeled and Unlabeled Data: An Empirical Study across Techniques and Domains," J. Artificial Intelligence Research, vol. 23, pp. 331-366, 2005.
14. K. Chen and S. Wang, "Semi-Supervised Learning via Regularized Boosting Working on Multiple Semi-Supervised Assumptions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 1, pp. 129-143, Jan. 2011.
15. R. Collobert, F. Sinz, J. Weston, and L. Bottou, "Large Scale Transductive SVMs," J. Machine Learning Research, vol. 7, pp. 1687-1712, 2006.
16. F.G. Cozman, I. Cohen, and M.C. Cirelo, "Semi-Supervised Learning of Mixture Models," Proc. 20th Int'l Conf. Machine Learning, pp. 99-106, 2003.
17. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
18. R.E. Fan, P.H. Chen, and C.J. Lin, "Working Set Selection Using Second Order Information for Training Support Vector Machines," J. Machine Learning Research, vol. 6, pp. 1889-1918, 2005.
19. C. Goutte, H. Déjean, E. Gaussier, N. Cancedda, and J.M. Renders, "Combining Labelled and Unlabelled Data: A Case Study on Fisher Kernels and Transductive Inference for Biological Entity Recognition," Proc. Sixth Conf. Natural Language Learning, pp. 1-7, 2002.
20. Y. Grandvalet and Y. Bengio, "Semi-Supervised Learning by Entropy Minimization," Proc. Advances in Neural Information Processing Systems, vol. 17, 2004.
21. C.J. Hsieh, K.W. Chang, C.J. Lin, S.S. Keerthi, and S. Sundararajan, "A Dual Coordinate Descent Method for Large-Scale Linear SVM," Proc. 25th Int'l Conf. Machine Learning, pp. 408-415, 2008.
22. A.K. Jain and R.C. Dubes, Algorithms for Clustering Data. Prentice Hall, 1988.
23. T. Joachims, "Transductive Inference for Text Classification Using Support Vector Machines," Proc. 16th Int'l Conf. Machine Learning, pp. 200-209, 1999.
24. N. Kasabov and S. Pang, "Transductive Support Vector Machines and Applications in Bioinformatics for Promoter Recognition," Proc. Int'l Conf. Neural Networks and Signal Processing, pp. 1-6, 2003.
25. S. Kirkpatrick, "Optimization by Simulated Annealing: Quantitative Studies," J. Statistical Physics, vol. 34, no. 5, pp. 975-986, 1984.
26. P.J.M. Laarhoven and E.H.L. Aarts, Simulated Annealing: Theory and Applications. Springer, 1987.
27. M. Li and Z.-H. Zhou, "SETRED: Self-Training with Editing," Proc. Ninth Pacific-Asia Conf. Knowledge Discovery and Data Mining, pp. 611-621, 2005.
28. Y.-F. Li, J.T. Kwok, and Z.-H. Zhou, "Semi-Supervised Learning Using Label Mean," Proc. 26th Int'l Conf. Machine learning, pp. 633-640, 2009.
29. Y.-F. Li, I.W. Tsang, J.T. Kwok, and Z.-H. Zhou, "Tighter and Convex Maximum Margin Clustering," Proc. 12th Int'l Conf. Artificial Intelligence and Statistics, pp. 344-351, 2009.
30. Y.-F. Li, I.W. Tsang, J.T. Kwok, and Z.-H. Zhou, "Convex and Scalable Weakly Labeled SVMS," J. Machine Learning Research, vol. 14, pp. 2151-2188, 2013.
31. Y.-F. Li and Z.-H. Zhou, "Improving Semi-Supervised Support Vector Machines through Unlabeled Instances Selection," Proc. 25th AAAI Conf. Artificial Intelligence, pp. 386-391, 2011.
32. Y.-F. Li and Z.-H. Zhou, "Towards Making Unlabeled Data Never Hurt," Proc. 28th Int'l Conf. Machine learning, pp. 1081-1088, 2011.
33. W. Liu, J.-F. He, and S.-F. Chang, "Large Graph Construction for Scalable Semi-Supervised Learning," Proc. 27th Int'l Conf. Machine Learning, pp. 679-686, 2010.
34. W. Liu, J. Wang, and S.-F. Chang, "Robust and Scalable Graph-Based Semisupervised Learning," Proc. IEEE, vol. 100, no. 9, pp. 2624-2638, Sep. 2012.
35. D.J. Miller and H.S. Uyar, "A Mixture of Experts Classifier with Learning Based on Both Labelled and Unlabelled Data," Proc. Advances in Neural Information Processing Systems, vol. 9, pp. 571-577, 1997.
36. K. Nigam, A.K. McCallum, S. Thrun, and T. Mitchell, "Text Classification from Labeled and Unlabeled Documents Using EM," Machine Learning, vol. 39, no. 2, pp. 103-134, 2000.
37. V. Sindhwani, S.S. Keerthi, and O. Chapelle, "Deterministic Annealing for Semi-Supervised Kernel Machines," Proc. 23rd Int'l Conf. Machine Learning, pp. 841-848, 2006.
38. A. Singh, R. Nowak, and X. Zhu, "Unlabeled Data: Now It Helps, Now It Doesn't," Proc. Advances in Neural Information Processing Systems, vol. 21, pp. 1513-1520, 2009.
39. E.K. Tang, P.N. Suganthan, and X. Yao, "An Analysis of Diversity Measures," Machine Learning, vol. 65, no. 1, pp. 247-271, 2006.
40. V.N. Vapnik, Statistical Learning Theory. Wiley, 1998.
41. J. Wang, T. Jebara, and S.-F. Chang, "Graph Transduction via Alternating Minimization," Proc. 25th Int'l Conf. Machine Learning, pp. 1144-1151, 2008.
42. L. Wang, K. Chan, and Z. Zhang, "Bootstrapping SVM Active Learning by Incorporating Unlabelled Images for Image Retrieval," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 629-634, 2003.
43. L. Xu and D. Schuurmans, "Unsupervised and Semi-Supervised Multi-Class Support Vector Machines," Proc. 20th Nat'l Conf. Artificial Intelligence, pp. 904-910, 2005.
44. A.L. Yuille and A. Rangarajan, "The Concave-Convex Procedure," Neural Computation, vol. 15, no. 4, pp. 915-936, 2003.
45. K. Zhang, J.T. Kwok, and B. Parvin, "Prototype Vector Machine for Large Scale Semi-Supervised Learning," Proc. 26th Int'l Conf. Machine Learning, pp. 1233-1240, 2009.
46. K. Zhang, I.W. Tsang, and J.T. Kwok, "Maximum Margin Clustering Made Practical," Proc. 24th Int'l Conf. Machine Learning, pp. 1119-1126, 2007.
47. T. Zhang and F. Oles, "The Value of Unlabeled Data for Classification Problems," Proc. 17th Int'l Conf. Machine Learning, pp. 1191-1198, 2000.
48. D. Zhou, O. Bousquet, T.Navin Lal, J. Weston, and B. Schölkopf, "Learning with Local and Global Consistency," Proc. Advances in Neural Information Processing Systems , vol. 16, pp. 595-602, 2004.
49. Z.-H. Zhou, Ensemble Methods: Foundations and Algorithms. Chapman & Hall, 2012.
50. Z.-H. Zhou and M. Li, "Tri-Training: Exploiting Unlabeled Data Using Three Classifiers," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 11, pp. 1529-1541, Nov. 2005.
51. Z.-H. Zhou and M. Li, "Semi-Supervised Learning by Disagreement," Knowledge and Information Systems, vol. 24, no. 3, pp. 415-439, 2010.
52. X. Zhu, "Semi-Supervised Learning Literature Survey," technical report, Univ. of Wisconsin-Madison, 2007.
53. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions," Proc. 20th Int'l Conf. Machine Learning, pp. 912-919, 2003.