Successive Overrelaxation for Laplacian Support Vector Machine

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 4, 2015, Pages 674-683

  Qi, Zhiquan ^a   Tian, Yingjie ^a   Shi, Yong ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Classification; machine learning; semisupervised learning (SSL); support vector machines (SVMs)

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); DATA MINING; LAPLACE TRANSFORMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION; SCHEDULING; SUPERVISED LEARNING;

LARGE-SCALE PROBLEM; MANIFOLD REGULARIZATION; OPTIMIZATION MODELING; SEMI-SUPERVISED CLASSIFICATION; SEMI-SUPERVISED LEARNING (SSL); STATE-OF-THE-ART PERFORMANCE; SUCCESSIVE OVER RELAXATION; SUPPORT VECTOR MACHINE (SVMS);

SUPPORT VECTOR MACHINES;

EID: 85027923742     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2320738     Document Type: Article

References (33)

1. C. Cortes and V. N. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
2. M. Seeger. (2001, Dec.). Learning with labeled and unlabeled data. Inst. Adaptive and Neural Comput., Univ. Edinburgh, Edinburgh, U.K. [Online]. Available: http://infoscience.epfl.ch/record/161327/files/review.pdf
3. O. Chapelle, B. Schölkopf, and A. Zien, Eds., Semi-Supervised Learning. Cambridge, MA, USA: MIT Press, 2006.
4. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ. Wisconsin-Madison, Tech. Rep. TR-1530, 2005.
5. Z. Xu, I. King, M. Lyu, and R. Jin, "Discriminative semi-supervised feature selection via manifold regularization," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
6. Y. Huang, D. Xu, and F. Nie, "Semi-supervised dimension reduction using trace ratio criterion," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 519-526, Mar. 2012.
7. Y. Wang, S. Chen, and Z. Zhou, "New semi-supervised classification method based on modified cluster assumption," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 689-702, May 2012.
8. E. Hu, S. Chen, D. Zhang, and X. Yin, "Semisupervised kernel matrix learning by kernel propagation," IEEE Trans. Neural Netw. Learn. Syst., vol. 21, no. 11, pp. 1831-1841, Nov. 2010.
9. F. Nie, D. Xu, I.-H. Tsang, and C. Zhang, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1921-1932, Jul. 2010.
10. S. Xiang, F. Nie, and C. Zhang, "Semi-supervised classification via local spline regression," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 11, pp. 2039-2053, Nov. 2010.
11. F. Nie, S. Xiang, Y. Jia, and C. Zhang, "Semi-supervised orthogonal discriminant analysis via label propagation," Pattern Recognit., vol. 42, no. 11, pp. 2615-2627, 2009.
12. F. Nie, D. Xu, X. Li, and S. Xiang, "Semisupervised dimensionality reduction and classification through virtual label regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 3, pp. 675-685, Jun. 2011.
13. C. Hou, F. Nie, F. Wang, C. Zhang, and Y. Wu, "Semisupervised learning using negative labels," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 420-432, Mar. 2011.
14. F. Nie, S. Xiang, Y. Liu, and C. Zhang, "A general graph-based semisupervised learning with novel class discovery," Neural Comput. Appl., vol. 19, no. 4, pp. 549-555, 2010.
15. M. Qian, F. Nie, and C. Zhang, "Efficient multi-class unlabeled constrained semi-supervised SVM," in Proc. CIKM, New York, NY, USA, Nov. 2009, pp. 1665-1668.
16. T. Joachims, "Transductive learning via spectral graph partitioning," in Proc. ICML, Washington, DC, USA, Aug. 2003, pp. 290-297.
17. M. Belkin and P. Niyogi, "Using manifold structure for partially labelled classification," in Proc. NIPS, Vancouver, BC, Canada, Dec. 2002, pp. 953-960.
18. X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-supervised learning using Gaussian fields and harmonic functions," in Proc. ICML, Washington, DC, USA, Aug. 2003, pp. 912-919.
19. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples,"J. Mach. Learn. Res., vol. 7, pp. 2399-2434, Nov. 2006.
20. S. S. Keerthi, D. Decoste, and T. Joachims, "A modified finite newton method for fast solution of large scale linear svms," J. Mach. Learn. Res., vol. 6, pp. 341-361, Mar. 2005.
21. O. Chapelle, "Training a support vector machine in the primal," Neural Comput., vol. 19, no. 5, pp. 1155-1178, May 2007.
22. Y. Singer and N. Srebro, "Pegasos: Primal estimated sub-gradient solver for SVM," in Proc. ICML, Corvalis, OR, USA, Jun. 2007, pp. 807-814.
23. S. Melacci and M. Belkin, "Laplacian support vector machines trained in the primal," J. Mach. Learn. Res., vol. 12, pp. 1149-1184, Mar. 2011.
24. O. L. Mangasarian and D. R. Musicant, "Successive overrelaxation for support vector machines," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1032-1037, Sep. 1999.
25. A. Tikhonov, "Regularization of incorrectly posed problems," Soviet Math. Doklady, vol. 4, pp. 1624-1627, Feb. 1963.
26. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," Adv. Comput. Math., vol. 13, no. 1, pp. 1-50, Apr. 2000.
27. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2002.
28. M. Belkin and P. Niyogi, "Towards a theoretical foundation for Laplacian-based manifold methods," J. Comput. Syst. Sci., vol. 74, no. 8, pp. 1289-1308, 2008.
29. J. C. Platt, Fast Training of Support Vector Machines Using Sequential Minimal Optimization. Cambridge, MA, USA: MIT Press, 1999.
30. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan, "A dual coordinate descent method for large-scale linear SVM," in Proc. ICML, Helsinki, Finland, Jun. 2008, pp. 408-415.
31. K.-W. Chang, C.-J. Hsieh, and C.-J. Lin, "Coordinate descent method for large-scale L2-loss linear support vector machines," J. Mach. Learn. Res., vol. 9, pp. 1369-1398, Jul. 2008.
32. V. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer-Verlag, 1995.
33. R.-E. Fan, P.-H. Chen, and C.-J. Lin, "Working set selection using the second order information for training SVM," J. Mach. Learn. Res., vol. 6, pp. 1889-1918, Dec. 2005.