A PSO and pattern search based memetic algorithm for SVMs parameters optimization

Neurocomputing

Volumn 117, Issue , 2013, Pages 98-106

  Bao, Yukun ^a   Hu, Zhongyi ^a   Xiong, Tao ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Memetic algorithms; Parameters optimization; Particle swarm optimization; Pattern search; Support vector machines

Indexed keywords

EXPLORATION AND EXPLOITATION; LOCAL REFINEMENT; MEMETIC ALGORITHMS; OPTIMUM SOLUTION; PARAMETERS OPTIMIZATION; PARTICLE SWARM OPTIMIZATION ALGORITHM; PATTERN SEARCH; POTENTIAL REGION;

ALGORITHMS; SUPPORT VECTOR MACHINES;

PARTICLE SWARM OPTIMIZATION (PSO);

ARTICLE; CLINICAL EFFECTIVENESS; EVOLUTIONARY ALGORITHM; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MEMETIC ALGORITHM; PARTICLE SWARM OPTIMIZATION ALGORITHM; PATTERN SEARCH; PRIORITY JOURNAL; PROBABILITY; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; SUPPORT VECTOR MACHINE; VALIDATION PROCESS;

EID: 84878941786     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.01.027     Document Type: Article

References (40)

1. Vapnik V.N. The Nature of Statistical Learning Theory 1995, Springer, New York.
2. Hsu C.W., Chang C.C., Lin C.J. A Practical Guide to Support Vector Classification, Department of Computer Science 2003, National Taiwan University.
3. Moore G., Bergeron C., Bennett K.P. Model selection for primal SVM. Mach. Learn. 2011, 85:175-208.
4. Chapelle O., Vapnik V., Bousqet O., Mukherjee S. Choosing multiple parameters for support vector machines. Mach. Learn. 2002, 46(1):131-159.
5. Keerthi S.S. Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms. IEEE Trans. Neural Networ. 2002, 13(5):1225-1229.
6. Duan K., Keerthi S.S., Poo A.N. Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing 2003, 51:41-59.
7. Chung K.M., Kao W.C., Sun C.L., Wang L.L., Lin C.J. Radius margin bounds for support vector machines with the RBF kernel. Neural Comput. 2003, 15:2643-2681.
8. Ayat N.E., Cheriet M., Suen C.Y. Automatic model selection for the optimization of SVM kernels. Patt. Recogn. 2005, 38(10):1733-1745.
9. Adankon M.M., Cheriet M. Optimizing resources in model selection for support vector machine. Patt. Recogn. 2007, 40(3):953-963.
10. Wang L., Xue P., Chan K.L. Two criteria for model selection in multiclass support vector machines. IEEE Trans. Syst. Man Cybern. Part B-Cybernetics 2008, 38(6):1432-1448.
11. Adankon M.M., Cheriet M. Model selection for the LS-SVM. Application to handwriting recognition. Patt. Recogn. 2009, 42(12):3264-3270.
12. Li S., Tan M. Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm. Neurocomputing 2010, 73:2089-2096.
13. Xu Z.B., Dai M.W., Meng D.Y. Fast and efficient strategies for model selection of Gaussian support vector machine. IEEE Trans. Syst. Man Cybern. Part B-Cybernetics 2009, 39(5):1292-1307.
14. F. Imbault, K. Lebart, A stochastic optimization approach for parameter tuning of Support Vector Machines, in: J. Kittler, M. Petrou, M. Nixon (Eds.), Proceedings of the 17th International Conference on Pattern Recognition, vol 4, IEEE Computer Soc, Los Alamitos, 2004, pp. 597-600.
15. Guo X.C., Yang J.H., Wu C.G., Wang C.Y., Liang Y.C. A novel LS-SVMs hyper-parameter selection based on particle swarm optimization. Neurocomputing 2008, 71:3211-3215.
16. Escalante H.J., Montes M., Sucar L.E. Particle swarm model selection. J. Mach. Learn. Res. 2009, 10:405-440. February.
17. Zhang X., Chen X., He Z. An ACO-based algorithm for parameter optimization of support vector machines. Expert Syst. Appl. 2010, 37(9):6618-6628.
18. Gomes T., Prudencio R., Soares C., Rossi A., Carvalho A. Combining meta-learning and search techniques to select parameters for support vector machines. Neurocomputing 2012, 75:3-13.
19. Kapp M.N., Sabourin R., Maupin P. A dynamic model selection strategy for support vector machine classifiers. Appl. Soft Comput. 2012, 12(8):2550-2565.
20. Moscato P., Norman M.G. A 'memetic' approach for the traveling salesman problem implementation of a computational ecology for combinatorial optimization on message-passing systems. Parallel Comput. Transputer Appl. 1992, 177-186.
21. P. Moscato, On evolution search optimization genetic algorithms and martial arts: towards memetic algorithms, caltech concurrent computation program, C3P Report, 826 (1989).
22. Tang J., Lim M.H., Ong Y.S. Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems. Soft Comput. 2007, 11(9):873-888.
23. Areibi S., Yang Z. Effective memetic algorithms for VLSI design=genetic algorithms+local search plus multi-level clustering. Evol. Comput. 2004, 12(3):327-353.
24. Elhossini A., Areibi S., Dony R. Strength pareto particle swarm optimization and hybrid EA-PSO for multi-objective optimization. Evol. Comput. 2010, 18(1):127-156.
25. Lara A., Sanchez G., Coello C., Schuetze O. HCS: a new local search strategy for memetic multiobjective evolutionary algorithms. IEEE Trans. Evol. Comput. 2010, 14(1):112-132.
26. Nguyen Q.H., Ong Y.S., Lim M.H. A probabilistic memetic framework. IEEE Trans. Evol. Comput. 2009, 13(3):604-623.
27. Vapnik V.N. Statistical Learning Theory 1998, John Wiley&Sons, Inc, New York.
28. Tay F.E.H., Cao L.J. Application of support vector machines in financial time series forecasting. Omega 2001, 29(4):309-317.
29. Chen X., Ong Y., Lim M., Tan K. A multi-facet survey on memetic computation. IEEE Trans. Evol. Comput. 2011, 15(5):591-607.
30. Neri F., Cotta C. Memetic algorithms and memetic computing optimization: a literature review. Swarm Evol. Comput. 2012, 2:1-14.
31. X. Hu, R.C. Eberhart, Y. Shi, Engineering optimization with particle swarm, in: Proceedings of the 2003 IEEE Swarm Intelligence Symposium, 2003, pp. 53-57.
32. Reyes M., Coello C. Multi-objective particle swarm optimizers: a survey of the state-of-the-art. Int. J. Comput. Intell. Res. 2006, 2(3):287-308.
33. Kennedy J., Eberhart R.C., Shi Y. Swarm Intelligence 2001, Morgan Kaufmann Publishers, San Francisco.
34. C. Chang, C. Lin, LIBSVM: a library for support vector machines, 2001. Software available from http://www.csie.ntu.edu.tw/cjlin/libsvm.
35. J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, 4 (1995) pp. 1942-1948.
36. Dolan E.D., Lewis R.M., Torczon V. On the local convergence of pattern search. SIAM J. Optim. 2003, 14(2):567-583.
37. Liu B., Wang L., Jin Y.H. An effective PSO-based memetic algorithm for flow shop scheduling. IEEE Trans. Syst. Man Cybern. Part B-Cybernetics 2007, 37(1):18-27.
38. Lozano M., Herrera F., Krasnogor N., Molina D. Real-coded memetic algorithms with crossover hill-climbing. Evol. Comput. 2004, 12(3):273-302.
39. Tang M.L., Yao X. A memetic algorithm for VLSI floorplanning. IEEE Trans. Syst. Man Cybern. Part B-Cybernetics 2007, 37(1):62-69.
40. Rätsch G., Onoda T., Müller K.R. Soft Margins for AdaBoost. Mach. Learn. 2001, 42(3):287-320.