Combining meta-learning and search techniques to select parameters for support vector machines

Neurocomputing

Volumn 75, Issue 1, 2012, Pages 3-13

  Gomes, Taciana A F ^a   Prudĉncio, Ricardo B C ^a   Soares, Carlos ^b   Rossi, André L D ^c   Carvalho, André ^c  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

^b UNIVERSITY OF PORTO   (Portugal)

^c UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Meta learning; Search; Support vector machines

Indexed keywords

INFORMATION ANALYSIS; PARAMETER ESTIMATION; PARTICLE SWARM OPTIMIZATION (PSO); SUPPORT VECTOR MACHINES; TABU SEARCH;

HYBRID ALGORITHMS; METALEARNING; PARAMETER SELECTION; REGRESSION PROBLEM; REGULARIZATION PARAMETERS; SEARCH; SEARCH ALGORITHMS; SUPPORT VECTOR MACHINE (SVMS);

LEARNING ALGORITHMS;

ARTICLE; CLASSIFICATION ALGORITHM; INTERMETHOD COMPARISON; LEARNING ALGORITHM; LIMIT OF DETECTION; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PARTICLE SWARM OPTIMIZATION; PREDICTION; PRIORITY JOURNAL; PROBLEM BASED LEARNING; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; REGRESSION ANALYSIS; SUPPORT VECTOR MACHINE; TABU SEARCH; VALIDATION PROCESS;

EID: 82455210873     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.07.005     Document Type: Article

References (31)

1. Soares C., Brazdil P., Kuba P. A meta-learning approach to select the kernel width in support vector regression. Machine Learning 2004, 54(3):195-209.
2. Cristianini N., Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods 2000, Cambridge University Press.
3. Chapelle O., Vapnik V., Bousquet O., Mukherjee S. Choosing multiple parameters for support vector machines. Machine Learning 2002, 46(1):131-159.
4. Cristianini N., Campbell C., Shawe-Taylor J. Dynamically adapting kernels in support vector machines. Proceedings of Neural Information Processing Workshop 1998, 204-210.
5. Ali S., Smith-Miles K.A. A meta-learning approach to automatic kernel selection for support vector machines. Neurocomputing 2006, 70(1-3):173-186.
6. Lessmann S., Stahlbock R., Crone S. Genetic algorithms for support vector machine model selection. International Joint Conference on Neural Networks 2006, 3063-3069.
7. Friedrichs F., Igel C. Evolutionary tuning of multiple SVM parameters. Neurocomputing 2005, 64:107-117.
8. Lorena A., de Carvalho A. Evolutionary tuning of SVM parameter values in multiclass problems. Neurocomputing 2008, 71:16-18.
9. Keerthi S.S., Lin C.-J. Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Computation 2003, 15(7):1667-1689.
10. Kuba P., Brazdil P., Soares C., Woznica A. Exploiting sampling and meta-learning for parameter setting support vector machines. Proceedings of the IBERAMIA 2002 2002, 217-225.
11. Soares C., Brazdil P. Selecting parameters of SVM using meta-learning and kernel matrix-based meta-features. Proceedings of SAC 2006, 564-568.
12. Kennedy J., Eberhart R.C. Particle swarm optimization. Proceedings of the IEEE International Joint Conference on Neural Networks 1995, 1942-1948.
13. Glover F., Laguna M. Tabu Search 1998, Kluwer Academic Publishers, Dordrecht, The Netherlands.
14. Cawley G. Model selection for support vector machines via adaptive step-size tabu search. International Conference on Artificial Neural Networks and Genetic Algorithms 2001, 434-437.
15. Guo X., Yang J., Wu C., Wang C., Liang Y. A novel LS-SVMS hyper-parameter selection based on particle swarm optimization. Neurocomputing 2008, 71:3211-3215.
16. de Souza B., de Carvalho A., Ishii R. Multiclass SVM model selection using particle swarm optimization. Sixth International Conference on Hybrid Intelligent Systems 2006, 441-446.
17. Ali S., Smith K.A. Matching SVM kernel's suitability to data characteristics using tree by fuzzy c-means clustering. Third International Conference on Hybrid Intelligent Systems 2003, 553-562.
18. Ali S., Smith-Miles K. On optimal degree selection for polynomial kernel with support vector machines: Theoretical and empirical investigations. KES Journal 2007, 11(1):1-18.
19. Louis S., McDonnell J. Learning with case-injected genetic algorithms. IEEE Transactions on Evolutionary Computation 2004, 8(4):316-328.
20. Smith-Miles K. Cross-disciplinary perspectives on meta-learning for algorithm selection. ACM Computing Surveys 2008, 41(1):1-25.
21. Smith-Miles K. Towards insightful algorithm selection for optimisation using meta-learning concepts. Proceedings of the IEEE International Joint Conference on Neural Networks 2008, 4118-4124.
22. Kanda J., Carvalho A., Hruschka E., Soares C. Using meta-learning to classify traveling salesman problems. Brazilian Symposium on Neural Networks 2010, 73-78.
23. Gomes T., Prudĉncio R.B.C., Soares C., Rossi A., Carvalho A. Combining meta-learning and search techniques to SVM parameter selection. Brazilian Symposium on Neural Networks 2010, 79-84.
24. Brazdil P., Giraud-Carrier C., Soares C., Vilalta R. Metalearning: Applications to Data Mining, Cognitive Technologies 2009, Springer.
25. Prudĉncio R.B.C., Ludermir T.B. Meta-learning approaches to selecting time series models. Neurocomputing 2004, 61:121-137.
26. Chang C.-C., Lin C.-J. LIBSVM: a library for support vector machines 2001.
27. Vapnik V. Statistical Learning Theory 1998, Wiley, New York, NY.
28. C.-W. Hsu, C.-C. Chang, C.-J. Lin, A practical guide to support vector classification, Technical report, Department of Computer Science and Information Engineering, National Taiwan University, Taipei, 2003.
29. Shi Y., Eberhart R. A modified particle swarm optimizer. IEEE World Congress on Computational Intelligence 1998, 69-73.
30. Brazdil P., Soares C., Costa J.P., Louis S., McDonnell J. Ranking learning algorithms-using IBL and meta-learning on accuracy and time results. Machine Learning 2003, 50(3):251-277.
31. Wilcoxon F. Individual comparisons by ranking methods. Biometrics 1945, 1:80-83.