Combining a multi-objective optimization approach with meta-learning for SVM parameter selection

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2012, Pages 2909-2914

  De Miranda, Péricles B C ^a   Prudencio, Ricardo B C ^a   De Carvalho, Andrecarlos P L F ^b   Soares, Carlos ^c  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

^b UNIVERSITY OF SÃO PAULO   (Brazil)

^c UNIVERSITY OF PORTO   (Portugal)

Author keywords

Meta Learning; Multi Objective Optimization; Particle Swarm Optimization; SVM Parameter Selection

Indexed keywords

CROWDING DISTANCE; LEARNING PROBLEM; METALEARNING; MULTI OBJECTIVE; MULTI OBJECTIVE OPTIMIZATIONS (MOO); MULTI-OBJECTIVE PROBLEM; OPTIMIZATION TECHNIQUES; PARAMETER SELECTION; PARETO FRONT; SEARCH PROCESS; SEARCH SPACES; SUPPORT VECTOR;

CYBERNETICS; MULTIOBJECTIVE OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO);

SUPPORT VECTOR MACHINES;

EID: 84872405026     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2012.6378235     Document Type: Conference Paper

References (23)

1. C. Soares, P. Brazdil, and P. Kuba. A meta-learning approach to select the kernel width in support vector regression. (4):195-209, 2000.
2. G. Narzisi. An Experimental Multi-Objective Study of the SVM Model Selection problem.
3. Yuan Ren and Guangchen Bai. Determination of Optimal SVM Parameters by Using GA/PSO, in Journal of Computers, vol. 5, number 8, 2010, pags. 1160-1168.
4. Carlo R. Raquel and Jr. Naval and C. Prospero An effective use of crowding distance in multiobjective particle swarm optimization, in Proceedings of the 2005 conference on Genetic and evolutionary computation, pags. 257-264, GECCO '05
5. Carmelo J. A. Bastos-Filho, Elliackin M. N. Figueiredo, Joaquim F. Martins-Filho, Daniel A. R. Chaves, Marcelo E. V. Segatto, S. Cani and Maria J. Pontes. Design of distributed optical-fiber raman ampli- fiers using multi-objective particle swarm optimization, in Journal of Microwaves, Optoelectronics and Electromagnetic Applications, 10(2), 323-336, 2011.
6. Carmelo J.A. Bastos-Filho, and Péricles B.C. Miranda. Multi-Objective Particle Swarm Optimization using speciation, in IEEE Symposium on Swarm Intelligence (SIS), 2011.
7. Y. Shi and R. C. Eberhart, "Parameter selection in particle swarm optimization,"in EP '98: Proceedings of the 7th International Conference on Evolutionary Programming VII. London, UK: Springer-Verlag, 1998, pp. 591-600.
8. G. Cawley. Model selection for support vector machines via adaptive step-size tabu search, in Proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms, 2001, pp. 434437.
9. C. Igel and T. Suttorp Multi-objective optimization of support vector machines, in Yaochu Jin (Ed.), Multi-objective Machine Learning Studies in Computational Intelligence, Vol. 16, pp. 199-220, Springer-Verlag, 2006. (Pubitemid 44869077)
10. S.S. Keerthi. Efficient tuning of svm hyperparameters using radius/ margin bound and iterative algorithms. IEEE Transactions on Neural Networks, 2002.
11. R. A. Santana, M. R. Pontes, and C. J. A. Bastos-Filho, "A multiple objective particle swarm optimization approach using crowding distance and roulette wheel," in Proceedings of the 2009 Ninth International Conference on Intelligent Systems Design and Applications, ser. ISDA'09. Washington, DC, USA: IEEE Computer Society, 2009, pp. 237-242.
12. C. Tsou, S. Chang, and P. Lai, Using Crowding Distance to Improve Multi-Objective PSO with Local Search - Swarm Intelligence, Focus on Ant and Particle Swarm Optimization. IN-Tech Education and Publishing, 2007.
13. C. Coello, G. Pulido, and M. Lechuga, "Handling multiple objectives with particle swarm optimization," IEEE Transactions on Evolutionary Computation, vol. 8, no. 3, pp. 256-279, 2004.
14. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 131-159, 2002. (Pubitemid 34129966)
15. B. de Souza, A. de Carvalho, and R. Ishii. Multiclass svm model selection using particle swarm optimization. Sixth International Conference on Hybrid Intelligent Systems, 2006.
16. C. Igel. Multiobjective Model Selection for Support Vector Machines, in Proc. of the 3rd Int. Conf. on Evolutionary Muilt Criterion Optimzation, 2005, pp. 534-546.
17. Y. Jin and B. Sendhoff, Pareto-Based Multi-Objective Machine Learning : An Overview and Case Studies, IEEE Transactions on Systems, Man and Cybernetics: Part C, vol. 38, no. 3, pp. 397-415, 2008. (Pubitemid 351663123)
18. S. Ali and K. A. Smith-Miles. A meta-learning approach to automatic kernel selection for support vector machines. Neurocomputing, 173-186, 2006. (Pubitemid 44615780)
19. T. Gomes, R. B. C. Prudencio, C. Soares, A. Rossi, A. Carvalho. Combining meta-learning and search techniques to svm parameter selection, in: Brazilian Symposium on Neural Networks, 2010, pp. 7984.
20. C.-W. Hsu, C.-C. Chang, and C.-J. Lin. Scikit-Learn: A Toolkit of Machine Learning in Python, Available: http://scikit-learn.org.
21. Frank, A. Asuncion, A. UCI Machine Learning Repository, Avaiable: http://archive.ics.uci.edu/ml. Irvine, CA: University of California, School of Information and Computer Science.
22. Kate A. Smith-Miles. Cross-Disciplinary Perspectives on Meta-Learning for Algorithm Selection, 2005.
23. E. Zitzler, K. Deb, and L. Thiele, "Comparison of multiobjective evolutionary algorithms: Empirical results," Evolutionary Computation Journal, vol. 8(2), pp. 125-148, 2000.