Multi-objective optimization and Meta-learning for SVM parameter selection

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2012, Pages

  Miranda, Pericles B C ^a   Prudencio, Ricardo B C ^a   De Carvalho, Andre Carlos P L F ^b   Soares, Carlos ^c  

^a FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

^b UNIVERSITY OF SÃO PAULO   (Brazil)

^c UNIVERSITY OF PORTO   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

INITIAL SOLUTION; INPUT PROBLEM; LEARNING PROBLEM; METALEARNING; MULTI OBJECTIVE; MULTI OBJECTIVE OPTIMIZATIONS (MOO); MULTI-OBJECTIVE OPTIMIZATION PROBLEM; OPTIMIZATION PROBLEMS; PARAMETER SELECTION; SEARCH ALGORITHMS; SEARCH PROCESS; SEARCH SPACES; SINGLE OBJECTIVE; SUPPORT VECTOR;

MULTIOBJECTIVE OPTIMIZATION; NEURAL NETWORKS;

SUPPORT VECTOR MACHINES;

EID: 84865094425     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2012.6252378     Document Type: Conference Paper

References (33)

1. C. Soares, P. Brazdil, and P. Kuba. A meta-learning approach to select the kernel width in support vector regression. (4):195-209, 2000.
2. N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods., Cambridge University Press, 2000.
3. N. Cristianini, C. Campbell, and J. Shawe-Taylor. Dynamically adapting kernels in support vector machines. NIPS, 204-210, 1998.
4. S. Ali and K. Smith-Miles. On optimal degree selection for polynomial kernel with support vector machines: Theoretical and empirical investigations. KES Journal, 1(1):1-18, 2007.
5. G. Narzisi. An Experimental Multi-Objective Study of the SVM Model Selection problem.
6. S. Lessmann, R. Stahlbock, and S. Crone. Genetic algorithms for support vector machine model selection. International Joint Conference on Neural Networks, 3063-3069, 2006.
7. F. Friedrichs and C. Igel. Evolutionary tuning of multiple svm parameters. Neurocomputing, 2005.
8. A. Lorena and A. de Carvalho. Evolutionary tuning of svm parameter values in multiclass problems. Neurocomputing, pages 16-18.
9. S.S. Keerthi. Efficient tuning of svm hyperparameters using radius/ margin bound and iterative algorithms. IEEE Transactions on Neural Networks, 2002.
10. P. Kuba, P. Brazdil, C. Soares, and A. Woznica. Exploiting sampling and meta-learning for parameter setting support vector machines. Proceedings of the IBERAMIA, pages 217-225, 2001.
11. C. Coello, G. Pulido, and M. Lechuga, "Handling multiple objectives with particle swarm optimization," IEEE Transactions on Evolutionary Computation, vol. 8, no. 3, pp. 256-279, 2004.
12. G. Cawley. Model selection for support vector machines via adaptive step-size tabu search. Proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms, 28(8):434-437, 2001.
13. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 131-159, 2002.
14. B. de Souza, A. de Carvalho, and R. Ishii. Multiclass svm model selection using particle swarm optimization. Sixth International Conference on Hybrid Intelligent Systems, 2006.
15. T. Glasmachers and C. Igel. Gradient-based adaptation of general gaussian kernels. Neural Comput., 2005.
16. C. Igel. Multiobjective Model Selection for Support Vector Machines, in Proc. of the 3rd Int. Conf. on Evolutionary Muilt Criterion Optimzation, 2005, pp. 534-546.
17. C. Igel and T. Suttorp Multi-objective optimization of support vector machines, in Yaochu Jin (Ed.), Multi-objective Machine Learning Studies in Computational Intelligence, Vol. 16, pp. 199-220, Springer-Verlag, 2006
18. Y. Jin and B. Sendhoff, Pareto-Based Multi-Objective Machine Learning : An Overview and Case Studies, IEEE Transactions on Systems, Man and Cybernetics: Part C, vol. 38, no. 3, pp. 397-415, 2008.
19. S. Ali and K. A. Smith-Miles. A meta-learning approach to automatic kernel selection for support vector machines. Neurocomputing, 173-186, 2006.
20. C. Soares and P. Brazdil. Selecting parameters of svm using metalearning and kernel matrix-based meta-features. SAC, 2006.
21. S. Ali and K. A. Smith. Matching svm kernel's suitability to data characteristics using tree by fuzzy c-means clustering. Third International Conference on Hybrid Intelligent Systems, 2010.
22. T. Gomes, R. B. C. Prudencio, C. Soares, A. Rossi, A. Carvalho. Combining meta-learning and search techniques to svm parameter selection, in: Brazilian Symposium on Neural Networks, 2010, pp. 7984.
23. K. Deb and D. Kalyanmoy, Multi-Objective Optimization Using Evolutionary Algorithms, 1st ed. Wiley, jun 2001.
24. S. Louis and J. McDonnell. Learning with case-injected genetic algorithms. IEEE Transactions on Evolutionary Computation, 2004.
25. S. S. Keerthi and C.-J. Lin. Asymptotic behaviors of support vector machines with gaussian kernel. In Tomasz Imielinski and Hank Korth, editors, Mobile Computing, pages 153-181. Kluwer Academic Publishers, 1996.
26. C.-W. Hsu, C.-C. Chang, and C.-J. Lin. Scikit-Learn: A Toolkit of Machine Learning in Python, Available: http://scikit-learn.org.
27. WEKA, The University of Waikato, Available: http://www.cs.waikato.ac.nz/ ml/weka/.
28. Frank, A. Asuncion, A. UCI Machine Learning Repository, Avaiable: http://archive.ics.uci.edu/ml. Irvine, CA: University of California, School of Information and Computer Science.
29. Kate A. Smith-Miles. Cross-Disciplinary Perspectives on Meta-Learning for Algorithm Selection, 2005.
30. E. Zitzler and L. Thiele, "Multiobjective optimization using evolutionary algorithms - a comparative case study," in Conference on Parallel Problem Solvin from Nature Algorithms (PPSN V), 1998, pp. 292-301.
31. J. R. Schott, "Fault tolerant design using single and multi-criteria genetic algorithms," Master's thesis, Department of Aeronautics and Astrounatics, Massacgusettes Institute of Technology, Bosto, MA, 1995.
32. E. Zitzler, K. Deb, and L. Thiele, "Comparison of multiobjective evolutionary algorithms: Empirical results," Evolutionary Computation Journal, vol. 8(2), pp. 125-148, 2000.
33. M. Takaki, D. Cavalcanti, R. Gheyi, J. Iyoda, M. d'Amorim, and R. B. Prudêncio, "A comparative study of randomized constraint solvers for random-symbolic testing," in Proceedings of the Nasa Formal Methods Symposium, 2008, pp. 56-65.