Developing parallel sequential minimal optimization for fast training support vector machine

Neurocomputing

Volumn 70, Issue 1-3, 2006, Pages 93-104

  Cao, L J ^a   Keerthi, S S ^b   Ong, C J ^b   Uvaraj, P ^c   Fu, X J ^c   Lee, H P ^c  

^a FUDAN UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c INSTITUTE OF HIGH PERFORMANCE COMPUTING   (Singapore)

Author keywords

Message passing interface (MPI); Parallel algorithm; Sequential minimal optimization (SMO); Support vector machine (SVM)

Indexed keywords

OPTIMIZATION; PROGRAM PROCESSORS; SEQUENTIAL MACHINES; WORLD WIDE WEB;

MESSAGE PASSING INTERFACE; SEQUENTIAL MINIMAL OPTIMIZATION; SUPPORT VECTOR MACHINE;

PARALLEL ALGORITHMS;

ACCURACY; ALGORITHM; ARTICLE; COMPUTER; CONTROLLED STUDY; INCOME; INFORMATION PROCESSING; INTERNET; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; PROBLEM SOLVING; PROCESS DESIGN; SUPPORT VECTOR MACHINE;

EID: 33750977854     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.05.007     Document Type: Article

References (16)

1. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Knowledge Discovery Data Mining 2 2 (1998) 955-974
2. Cao L.J., and Tay F.E.H. Support vector machines with adaptive parameters in financial time series forecasting. IEEE Trans. Neural Networks 14 6 (2003) 1506-1518
3. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, available at 〈http://www.csie.ntu.edu.tw/~cjlin/libsvm/〉.
4. Collobert R., Bengio S., and Bengio Y. A parallel mixture of SVMs for very large scale problems. Neural Comput. 14 5 (2002) 1105-1114
5. J.X. Dong, A. Krzyzak, C.Y. Suen, A fast SVM training algorithm, Pattern Recog. Artif. Intell., 2002, in press.
6. J.X. Dong, A. Krzyzak, C.Y. Suen, A fast parallel optimization for training support vector machine, In: P. Perner, A. Rosenfeld, (Eds.) Proceedings of third International Conference on Machine Learning and Data Mining, Springer Lecture Notes in Artificial Intelligence (LNAI 2734), Leipzig, Germany, July 5-7, 2003, pp. 96-105.
7. C.W. Hsu, C.C. Chang, C.J. Lin, A Practical Guide to Support Vector Classification. at 〈http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf〉.
8. Joachims T. Making large-scale support vector machine learning practical. In: Scholkopf B., Burges C., and Smola A. (Eds). Advances in Kernel Methods: Support Vector Machines (1998), MIT Press, Cambridge, MA
9. Keerthi S.S., Shevade S.K., Bhattaacharyya C., and Murthy K.R.K. Improvements to Platt's SMO algorithm for SVM classifier design. Neural Comput. 13 (2001) 637-649
10. E. Osuna, R. Freund, F. Girosi, An improved algorithm for support vector machines, NNSP'97: Proceedings of the IEEE Signal Processing Society Workshop, Amelia Island, USA, 1997, pp. 276-285.
11. Pacheco P.S. Parallel Programming with MPI (1997), Morgan Kaufmann Publishers, San Francisco, California
12. Platt J.C. Fast training of support vector machines using sequential minimal optimisation. In: Scholkopf B., Burges C.J.C., and Smola A.J. (Eds). Advances in Kernel Methods-Support Vector Learning (1999), MIT Press, Cambridge, MA 185-208
13. Shevade S.K., Keerthi S.S., Bhattacharyya C., and Murthy K.R.K. Improvements to the SMO algorithm for SVM regression. IEEE Trans. Neural Networks 11 5 (2000) 1188-1193
14. Vapnik V.N. Estimation of Dependence Based on Empirical Data (1982), Springer, New York
15. Vapnik V.N. The Nature of Statistical Learning Theory (1995), Springer, New York
16. Zanghirati G., and Zanni L. A parallel solver for large quadratic programs in training support vector machines. Parallel Comput. 29 4 (2003) 535-551