A dynamic model selection strategy for support vector machine classifiers

Applied Soft Computing Journal

Volumn 12, Issue 8, 2012, Pages 2550-2565

  Kapp, Marcelo N ^a   Sabourin, Robert ^a   Maupin, Patrick ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b DEFENCE RESEARCH AND DEVELOPMENT CANADA VALCARTIER   (Canada)

Author keywords

Dynamic optimization; Model selection; Particle Swarm Optimization; Support Vector Machines

Indexed keywords

COMPUTATIONAL TIME; DYNAMIC MODEL SELECTIONS; DYNAMIC OPTIMIZATION; GENERALIZATION ERROR; GRID-SEARCH METHOD; ITS EFFICIENCIES; MODEL SELECTION; OPTIMAL SELECTION; PARAMETERIZED MODEL; PERFORMANCE MEASURE; POOR PERFORMANCE; POTENTIAL SOLUTIONS; SUPPORT VECTOR; SVM MODEL; SWARM INTELLIGENCE; TRAINING DATA SETS;

ARTIFICIAL INTELLIGENCE; OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); PATTERN RECOGNITION;

SUPPORT VECTOR MACHINES;

EID: 84861845640     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.04.001     Document Type: Article

References (36)

1. M.N. Kapp, R. Sabourin, and P. Maupin A PSO-based framework for dynamic SVM model selection Proceedings of the Genetic and Evolutionary Computation Conference 2009 1227 1234
2. V.N. Vapnik Statistical Learning Theory 1998 Wiley NY
3. O. Chapelle, and V. Vapnik Model selection for support vector machines Advances in Neural Information Processing Systems 1999 230 236
4. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer Verlag NY
5. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods 2000 Cambridge University Press
6. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee Choosing multiple parameters for support vector machines Machine Learning 46 1-3 2002 131 159 (Pubitemid 34129966)
7. N. Ayat, M. Cheriet, and C. Suen Automatic model selection for the optimization of SVM kernels Pattern Recognition 38 10 2005 1733 1745 (Pubitemid 41037105)
8. C.C. Chang, C.J. Lin, Libsvm: A Library for Support Vector Machines, 2005, URL http://www.csie.ntu.edu.tw/cjlin/libsvm/.
9. C.-W. Hsu, and C.-J. Lin A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425 (Pubitemid 34475042)
10. C.-M. Huang, Y.-J. Lee, D.K. Lin, and S.-Y. Huang Model selection for support vector machines via uniform design Computational Statistics & Data Analysis 52 1 2007 335 346 (Pubitemid 47331723)
11. Z. Chunhong, and J. Licheng Automatic parameters selection for SVM based on GA Proceedings of the 5th World Congress on Intelligent Control and Automation 2004 1869 1872
12. G. Cohen, M. Hilario, and A. Geissbuhler Model selection for support vector classifiers via genetic algorithms. An application to medical decision support Proceedings of the 5th International Symposium on Biological and Medical Data Analysis 2004 200 211 (Pubitemid 39747712)
13. T. Suttorp, and C. Igel Multi-objective optimization of support vector machines Multi-Objective Machine Learning, Vol. 16 of Studies in Computational Intelligence 2006 Springer pp. 199-220
14. C. Chatelain, S. Adam, Y. Lecourtier, L. Heutte, and T. Paquet Multi-objective optimization for SVM model selection Proceedings of the 9th International Conference on Document Analysis and Recognition 2007 427 431
15. F. Friedrichs, and C. Igel Evolutionary tuning of multiple SVM parameters Proceedings of the 12th European Symposium on Artificial Neural Networks 2004 519 524
16. B.F. de Souza, A.C.P.L.F. de Carvalho, R. Calvo, and R.P. Ishii Multiclass SVM model selection using particle swarm optimization Proceedings of the 6th International Conference on Hybrid Intelligent Systems 2006 31 34
17. M. Jiang, and X. Yuan Construction and application of PSO-SVM model for personal credit scoring Proceedings of the International Conference on Computational Science Lecture Notes in Computer Science 2007 158 161
18. G. Valentini, Ensemble Methods based on Bias-variance Analysis, Ph.D. Thesis, University of Genova, Genova, Italy, 2003.
19. C. Domeniconi, and D. Gunopulos Incremental support vector machine construction Proceedings of the International Conference on Data Mining 2001 589 592
20. C.P. Diehl, and G. Cauwenberghs SVM incremental learning, adaptation and optimization Proceedings of the International Joint Conference on Neural Networks 2003 2685 2690
21. G. Valentini An experimental bias-variance analysis of SVM ensembles based on resampling techniques IEEE Transactions on Systems Man and Cybernetics Part B 35 6 2005 1252 1271 (Pubitemid 41800424)
22. A. Shilton, M. Palaniswami, D. Ralph, and A.C. Tsoi Incremental training of support vector machines IEEE Transactions on Neural Networks 16 2005 114 131 (Pubitemid 40241914)
23. Y. Jin, and J. Branke Evolutionary optimization in uncertain environments - A survey IEEE Transactions on Evolutionary Computation 9 3 2005 303 317 (Pubitemid 40871134)
24. L. Cohen, G. Avrahami-Bakish, M. Last, A. Kandel, and O. Kipersztok Real-time data mining of non-stationary data streams from sensor networks Information Fusion 9 3 2008 344 353 (Pubitemid 351680781)
25. J. Kennedy, and R.C. Eberhart Particle swarm intelligence Proceedings of the International Conference on Neural Networks 1995 1942 1948
26. J. Kennedy Some issues and practices for particle swarms Proceedings of the IEEE Swarm Intelligence Symposium 2007 801 808
27. M. Clerc, and J. Kennedy The particle swarm - explosion stability and convergence in a multidimensional complex space IEEE Transactions on Evolutionary Computation 6 1 2002 58 73 (Pubitemid 34404564)
28. A. Carlisle, and G. Dozier Tracking changing extrema with adaptive particle swarm optimizer Proceedings of the 5th Biannual World Automation Congress Orlando, USA 2002 265 270
29. X. Hu, and R.C. Eberhart Adaptive particle swarm optimization: detection and response to dynamic systems Proceedings of the Congress on Evolutionary Computation 2002 1666 1670
30. M. Clerc Particle Swarm Optimization 2006 ISTE Publishing Company London
31. P. Henniges, E. Granger, and R. Sabourin Factors of overtraining with fuzzy ARTMAP neural networks Proceedings of the International Joint Conference on Neural Networks 2005 1 4
32. G.A. Carpenter, S. Grossberg, and J.H. Reynolds ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network Neural Networks 4 5 1991 565 588 (Pubitemid 21710141)
33. C.L. Blake, C.J. Merz, UCI Repository of Machine Learning Databases, 1998, URL http://www.ics.uci.edu/∼mlearn/MLRepository.html.
34. D. Michie, D.J. Spiegelhalter, C.C. Taylor, Machine Learning. Neural and Statistical Classification, ftp.ncc.up.pt/pub/statlog/.
35. L.S. Oliveira, R. Sabourin, F. Bortolozzi, and C.Y. Suen A methodology for feature selection using multi-objective genetic algorithm for handwritten digit string recognition International Journal of Pattern Recognition and Artificial Intelligence 17 6 2003 903 930
36. Y. Park, and J. Sklansky Automated design of linear tree classifiers Pattern Recognition 23 1990 1393 1412