A study on SMO-type decomposition methods for support vector machines

IEEE Transactions on Neural Networks

Volumn 17, Issue 4, 2006, Pages 893-908

  Chen, Pai Hsuen ^a   Fan, Rong En ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Decomposition method; Sequential minimal optimization (SMO); Support vector machine (SVM)

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONVERGENCE OF NUMERICAL METHODS; NEURAL NETWORKS; OPTIMIZATION;

DECOMPOSITION METHOD; SEQUENTIAL MINIMAL OPTIMIZATION; SUPPORT VECTOR MACHINE;

LEARNING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; MATHEMATICAL COMPUTING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; NUMERICAL ANALYSIS, COMPUTER-ASSISTED;

EID: 33746932071     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.875973     Document Type: Article

References (28)

1. B. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. Workshop Computer Learning Theory, 1992, pp. 144-152, ACM Press.
2. C.-C. Chang, C.-W. Hsu, and C.-J. Lin, "The analysis of decomposition methods for support vector machines," IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 1003-1008, Jul. 2000.
3. C.-C. Chang and C.-J. Lin, LIBSVM: A library for support vector machines 2001 [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm
4. C.-C. Chang and C.-J. Lin, "Training v-support vector classifiers: Theory and algorithms," Neural Comput., vol. 13, no. 9, pp. 2119-2147, 2001.
5. C. Cortes, P. Haffner, and M. Mohri, "Positive definite rational kernels," in Proc. 16th Annu. Conf. Learning Theory, 2003, pp. 41-56.
6. C. Cortes and V. Vapnik, "Support-vector network," Mach. Learn., vol. 20, pp. 273-297, 1995.
7. D. J. Crisp and C. J. C. Burges, "A geometric interpretation of v-SVM classifiers," in Adv. Neural Inf. Process. Syst., S. Solla, T. Leen, and K.-R. Müller, Eds. Cambridge, MA: MIT Press, 2000, vol. 12.
8. R.-E. Fan, P.-H. Chen, and C.-J. Lin, "Working set selection using the second order information for training SVM," J. Mach. Learn. Res., vol. 6, pp. 1889-1918, 2005.
9. D. Hush and C. Scovel, "Polynomial-time decomposition algorithms for support vector machines," Mach. Learn., vol. 51, pp. 51-71, 2003.
10. T. Joachims, "Making large-scale SVM learning practical," in Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1998.
11. S. S. Keerthi and E. G. Gilbert, "Convergence of a generalized SMO algorithm for SVM classifier design," Mach. Learn., vol. 46, pp. 351-360, 2002.
12. S. S. Keerthi and C.-J. Lin, "Asymptotic behaviors of support vector machines with Gaussian kernel," Neural Comput., vol. 15, no. 7, pp. 1667-1689, 2003.
13. S. S. Keerthi and C. J. Ong, On the role of the threshold parameter in SVM training algorithms Dept. Mech. Production Eng., Nat. Univ. Singapore, Singapore, Tech. Rep. CD-00-09, 2000.
14. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy, "Improvements to Platt's SMO algorithm for SVM classifier design," Neural Comput., vol. 13, pp. 637-649, 2001.
15. C.-J. Lin, Linear Convergence of a Decomposition Method for Support Vector Machines Dept. Comp. Sci., Nat. Taiwan Univ., Tech. Rep., 2001.
16. C.-J. Lin, "On the convergence of the decomposition method for support vector machines," IEEE Trans. Neural Netw., vol. 12, no. 6, pp. 1288-1298, Nov. 2001.
17. C.-J. Lin, "Asymptotic convergence of an SMO algorithm without any assumptions," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 248-250, Jan. 2002.
18. C.-J. Lin, "A formal analysis of stopping criteria of decomposition methods for support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1045-1052, Sep. 2002.
19. H.-T. Lin and C.-J. Lin, A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO-type methods Dept. Comp. Sci. Inf. Eng., Nat. Taiwan Univ., Tech. Rep., 2003.
20. N. List and H. U. Simon, "A general convergence theorem for the decomposition method," in Proc. 17th Annu. Conf. Learning Theory, 2004, pp. 363-377.
21. S. Lucidi, L. Palagi, M. Sciandrone, and A. Risi, "A convergent decomposition algorithm for support vector machines," Comput. Optim. Appl., 2006, to be published.
22. C. A. Micchelli, "Interpolation of scattered data: Distance matrices and conditionally positive definite functions," Construct. Approx., vol. 2, pp. 11-22, 1986.
23. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: An application to face detection," in IEEE Proc. CVPR'97, New York, 1997, pp. 130-136.
24. L. Palagi and M. Sciandrone, "On the convergence of a modified version of SVMlight algorithm," Optim. Meth. Software, vol. 20, no. 2-3, pp. 315-332, 2005.
25. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods - Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1998.
26. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, no. 7, pp. 1443-1471, 2001.
27. B. Schölkopf, A. Smola, R. C. Williamson, and P. L. Bartlett, "New support vector algorithms," Neural Comput., vol. 12, pp. 1207-1245, 2000.
28. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.