Parallel sequential minimal optimization for the training of support vector machines

IEEE Transactions on Neural Networks

Volumn 17, Issue 4, 2006, Pages 1039-1049

  Cao, L J ^a   Keerthi, S S ^b   Ong, Chong Jin ^b   Zhang, J Q ^a   Periyathamby, Uvaraj ^c   Fu, Xiu Ju ^c   Lee, H P ^c  

^a FUDAN UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c INSTITUTE OF HIGH PERFORMANCE COMPUTING   (Singapore)

Author keywords

Message passing interface (MPI); Parallel algorithm; Sequential minimal optimization (SMO); Support vector machine (SVM)

Indexed keywords

INTERFACES (COMPUTER); OPTIMIZATION; PARALLEL ALGORITHMS; PROBLEM SOLVING;

DATA SET; MESSAGE PASSING INTERFACE (MPI); SEQUENTIAL MINIMAL OPTIMIZATION (SMO); SUPPORT VECTOR MACHINE (SVM);

PARALLEL PROCESSING SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; MATHEMATICAL COMPUTING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; NUMERICAL ANALYSIS, COMPUTER-ASSISTED;

EID: 33746869623     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.875989     Document Type: Article

References (18)

1. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
2. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Knowledge Discovery and Data Mining, vol. 2, no. 2, pp. 955-974, 1998.
3. L. J. Cao and F. E. H. Tay, "Support vector machines with adaptive parameters in financial time series forecasting," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1506-1518, Nov. 2003.
4. S. Gutta, R. J. Jeffrey, P. Jonathon, and H. Wechsler, "Mixture of experts for classification of gender, ethnic origin, and pose of human faces," IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 948-960, Jul. 2000.
5. K. Ikeda, "Effects of kernel function on nu support vector machines in extreme cases," IEEE Trans. Neural Netw., vol. 17, no. 1, pp. 1-9, Jan. 2006.
6. V. N. Vapnik, Estimation of Dependence Based on Empirical Data. New York: Springer-Verlag, 1982.
7. E. Osuna, R. Freund, and F. Girosi, "An improved algorithm for support vector machines," in Proc. IEEE Signal Processing Society Workshop (NNSP'97), Amelia Island, USA, 1997, pp. 276-285.
8. T. Joachims, B. Scholkopf, C. Burges, and A. Smola, Eds., "Making large-scale support vector machine learning practical," in Advances in Kernel Methods: Support Vector Machines. Cambridge, MA: MIT Press, 1998.
9. J. C. Platt, B. Scholkopf, C. Burges, and A. J. Smola, Eds., "Fast training of support vector machines using sequential minimal optimisation," in Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 185-208.
10. S. S. Keerthi, S. K. Shevade, C. Bhattaacharyya, and K. R. K. Murthy, "Improvements to Platt's SMO algorithm for SVM classifier design," Neural Comput, vol. 13, pp. 637-649, 2001.
11. S. K. Shevade, S. S. Keerthi, C. Bhattacharyya, and K. R. K. Murthy, "Improvements to the SMO algorithm for SVM regression," IEEE Trans. Neural Netw., vol. 11, no. 5, pp. 1188-1193, Sep. 2000.
12. C. C. Chang and C. J. Lin, LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm/
13. R. Collobert, S. Bengio, and Y. Bengio, "A parallel mixture of SVMS for very large scale problems," Neural Comput., vol. 14, no. 5, pp. 1105-1114, 2002.
14. J. X. Dong, A. Krzyzak, and C. Y. Suen, P. Perner and A. Rosenfeld, Eds., "A fast parallel optimization for training support vector machine," in Proc. 3rd Int. Conf. Machine Learning Data Mining, Leipzig, Germany, Jul. 5-7, 2003, vol. LNAI 2734, Springer Lecture Notes in Artificial Intelligence, pp. 96-105.
15. G. Zanghirati and L. Zanni, "A parallel solver for large quadratic programs in training support vector machines," Parallel Comput., vol. 29, no. 4, pp. 535-551, 2003.
16. B. H. Guang, K. Z. Mao, C. K. Siew, and D. S. Huang, "Fast modular network implementation for support vector machines," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1651-1663, Nov. 2005.
17. P. S. Pacheco, Parallel Programming With MPI. San Francisco, CA: Morgan Kaufmann, 1997.
18. J. X. Dong, A. Krzyzak, and C. Y. Suen, "A fast SVM training algorithm," Pattern Recognit. Artif. Intell., 2006, accepted for publication.