Optimization techniques for semi-supervised support vector machines

Journal of Machine Learning Research

Volumn 9, Issue , 2008, Pages 203-233

  Chapelle, Olivier ^a   Sindhwani, Vikas ^b   Keerthi, Sathiya S ^a  

^a YAHOO RESEARCH   (United States)

^b THE UNIVERSITY OF CHICAGO   (United States)

Author keywords

Non convex optimization; Semi supervised learning; Support vector machines; Transductive learning

Indexed keywords

NON-CONVEX OPTIMIZATION; SEMI-SUPERVISED LEARNING; TRANSDUCTIVE LEARNING;

ALGORITHMS; OPTIMIZATION; PROBLEM SOLVING; SUPPORT VECTOR MACHINES;

SUPERVISED LEARNING;

EID: 41549144249     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (35)

1. H. Abdi. Kendall rank correlation. In N.J. Salkind, editor, Encyclopedia of Measurement and Statistics. SAGE, 2006.
2. A. Astorino and A. Fuduli. Nonsmooth optimization techniques for semi-supervised classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(12):2135-2142, 2007.
3. Y. Bengio and Y. Grandvalet. Semi-supervised learning by entropy minimization. In Advances in Neural Information Processing Systems, volume 17, 2004.
4. K. Bennett and A. Demiriz. Semi-supervised support vector machines. In Advances in Neural Information Processing Systems 12, 1998.
5. T. De Bie and N. Cristianini. Semi-supervised learning using semi-definite programming. In O. Chapelle, B. Schoëlkopf, and A. Zien, editors, Semi-supervised Learning. MIT Press, 2006.
6. B. E. Boser, I. M. Guyon, and V. N. Vapnik. A training algorithm for optimal margin classifiers. In Fifth Annual Workshop on Computational Learning Theory, pages 144-152. ACM Press, New York, NY, 1992.
7. O. Chapelle. Training a support vector machine in the primal. Neural Computation, 19(5): 1155-1178, 2007.
8. O. Chapelle and A. Zien. Semi-supervised classification by low density separation. In Tenth International Workshop on Artificial Intelligence and Statistics, 2005.
9. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 46(1-3): 131-159, 2002.
10. O. Chapelle, M. Chi, and A. Zien. A continuation method for semi-supervised SVMs. In International Conference on Machine Learning, 2006a.
11. O. Chapelle, B. Schölkopf, and A. Zien, editors. Semi-Supervised Learning. MIT Press, Cambridge, MA, 2006b. URL http://www.kyb.tuebingen.mpg. de/ssl-book.
12. O. Chapelle, V. Sindhwani, and S. Keerthi. Branch and bound for semi-supervised support vector machines. In Advances in Neural Information Processing Systems, 2006c.
13. Y. Chen, G. Wang, and S. Dong. Learning with progressive transductive support vector machine. Pattern Recognition Letter, 24(12):1845-1855, 2003.
14. R. Cole, Y. Muthusamy, and M. Fanty. The ISOLET spoken letter database. Technical Report CS/E 90-004, Oregon Graduate Institute, 1990.
15. R. Collobert, F. Sinz, J. Weston, and L. Bottou. Large scale transductive SVMs. Journal of Machine Learning Research, 7:1687-1712, 2006.
16. R. Fletcher. Practical Methods of Optimization. John Wiley and Sons, 1987.
17. G. Fung and O. Mangasarian. Semi-supervised support vector machines for unlabeled data classification. Optimization Methods and Software, 15:29-44, 2001.
18. T. Joachims. Transductive inference for text classification using support vector machines. In International Conference on Machine Learning, 1999.
19. H. Liu and S.-T. Huang. Fuzzy transductive support vector machines for hypertext classification. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 12(1):21-36, 2004.
20. S. A. Nene, S. K. Nayar, and H. Murase. Columbia object image library (coil-20). Technical Report CUCS-005-96, Columbia Univ., USA, 1996.
21. B. Schölkopf and A.J. Smola. Learning with Kernels. MIT Press, Cambridge, MA, 2002.
22. M. Seeger. A taxonomy of semi-supervised learning methods. In O. Chapelle, B. Schölkopf, and A. Zien, editors, Semi-Supervised Lerning. MIT Press, 2006.
23. M. Silva, T. Maia, and A. Braga. An evolutionary approach to transduction in support vector machines. In Fifth International Conference on Hybrid Intelligent Systems, pages 329-334, 2005.
24. V. Sindhwani and S. S. Keerthi. Large scale semi-supervised linear SVMs. In SIGIR, 2006.
25. V. Sindhwani, P. Niyogi, and M. Belkin. Beyond the point cloud: From transductive to semi-supervised learning. In International Conference on Machine Learning, 2005.
26. V. Sindhwani, S. Keerthi, and O. Chapelle. Deterministic annealing for semi-supervised kernel machines. In International Conference on Machine Learning, 2006.
27. M. Szummer and T. Jaakkola. Partially labeled classification with markov random walks. In Advances in Neural Information Processing Systems, volume 14, 2001.
28. V. Vapnik and A. Sterin. On structural risk minimization or overall risk in a problem of pattern recognition. Automation and Remote Control, 10(3): 1495-1503, 1977.
29. V. N. Vapnik. Statistical Learning Theory. John Wiley & Sons, Inc., New York, 1998.
30. L. Wang, X. Shen, and W. Pan. On transductive support vector machines. In J. Verducci, X. Shen, and J. Lafferty, editors, Prediction and Discovery. American Mathematical Society, 2007.
31. W. Wapnik and A. Tscherwonenkis. Theorie der Zeichenerkennung. Akademie Verlag, Berlin, 1979.
32. Z. Wu. The effective energy transformation scheme as a special continuation approach to global optimization with application to molecular conformation. SIAM Journal on Optimization, 6(3): 748-768, 1996.
33. L. Xu, J. Neufeld, B. Larson, and D. Schuurmans. Maximum margin clustering. In Advances in Neural Information Processing Systems, 2004.
34. A. Yuille and A. Rangarajan. The concave-convex procedure. Neural Computation, 15:915-936, 2003.
35. X. Zhu and Z. Ghahramani. Learning from labeled and unlabeled data with label propagation. Technical Report 02-107, CMU-CALD, 2002.