Optimizing hyperparameters of support vector machines by genetic algorithms

Proceedings of the 2005 International Conference on Artificial Intelligence, ICAI'05

Volumn 1, Issue , 2005, Pages 74-80

  Lessmann, Stefan ^a   Stahlbock, Robert ^a   Crone, Sven F ^b  

^a UNIVERSITY OF HAMBURG   (Germany)

^b LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

Artificial support vector machine; Classification; Data mining; Decision support; Genetic algorithm

Indexed keywords

ARTIFICIAL SUPPORT VECTOR MACHINE; CLASSIFICATION; CLASSIFICATION PERFORMANCE; CLASSIFICATION TASKS; DECISION SUPPORT; DIRECT MARKETINGS; HYPERPARAMETERS; KERNEL FUNCTIONS; KERNEL PARAMETERS; OPTIMIZATION HEURISTICS; REAL-WORLD SCENARIOS; SOLUTION SPACES; STOCHASTIC SEARCHES; SUPPORT VECTORS;

ARTIFICIAL INTELLIGENCE; DATA MINING; DECISION SUPPORT SYSTEMS; GEARS; GENETIC ALGORITHMS; IMAGE RETRIEVAL; INFORMATION MANAGEMENT; MARKETING; MULTILAYER NEURAL NETWORKS; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 57349189253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. S. S. Haykin, Neural networks : a comprehensive foundation, 2nd ed. Upper Saddle River, NJ: Prentice Hall, 1999.
2. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford: Clarendon Press, 1995.
3. N. Cristianini and J. Shawe-Taylor, Eds., An Introduction to Support Vector Machines : and other kernel-based learning methods. Cambridge, UK: Cambridge University Press, 2000.
4. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge: Cambridge University Press, 2004.
5. V. Vapnik, "Learning and Generalization: Theoretical Bounds," in The handbook of brain theory and neural networks, M. A. Arbib, Ed. Cambridge, MA: MIT Press, 1995, pp. 516-522.
6. -, Statistical Learning Theory. New York: Wiley, 1998.
7. -, The Nature of Statistical Learning Theory, 2nd ed. New York: Springer, 1999.
8. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
9. J. H. Holland, Adaptation in natural and artificial systems : an introductory analysis with applications to biology, control, and artificial intelligence. Cambridge, MA: MIT Press, 1994.
10. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 2nd ed. Berlin: Springer, 1994.
11. H.-N. Nguyen, S.-Y. Ohn, and W.-J. Choi, "Combined kernel function for support vector machine and learning method based on evolutionary algorithm," in Neural Information Processing: 11th International Conference - Proc. of ICONIP 2004, Calcutta, India, Nov 22-25, 2004. Heidelberg: Springer, 2004, pp. 1273-1278, DOI 10.1007/b103766.
12. S.-Y. Ohn, H.-N. Nguyen, D. S. Kim, and J. S. Park, "Determining optimal decision model for support vector machine by genetic algorithm," in Computational and Information Science: First International Symposium - Proc. of CIS 2004, Shanghai, China, Dec 16-18, 2004. Heidelberg: Springer, 2004, pp. 592-597, dOI 10.1007/b104566.
13. S.-Y. Ohn, H.-N. Nguyen, and S.-D. Chi, "Evolutionary parameter estimation algorithm for combined kernel function in support vector machine," in Content Computing: Advanced Workshop on Content Computing - Proc. of AWCC 2004, Zhen Jiang, Jiang Su, China, Nov 15-17, 2004. Heidelberg: Springer, 2004, pp. 592-597, DOI 10.1007/b103383.
14. F. Friedrichs and C. Igel, "Evolutionary tuning of multiple svm parameters," Neurocomputing (in press), 2005.
15. D. Eads, D. Hill, S. Davis, S. Perkins, J. Ma, R. Porter, and J. Theiler, "Genetic algorithms and support vector machines for time series classification," in Proc. of Fifth Conf. on the Applications and Science of Neural Networks, Fuzzy Systems, and Evolutionary Computation. Symposium on Optical Science and Technology of the 2002 SPIE Annual Meeting, Seattle, WA, July 2002., 2002, pp. 74-85, 1A-UR-02-6212.
16. R. Stahlbock, Evolutionäre Entwicklung künstlicher neuronaler Netze zur Lösung betriebswirtschaftlicher Klassifikationsprobleme. Berlin: WiKu, 2002.
17. -, "An evolutionary neural classification approach to evaluate retail stores and support decisions on their location, in-store design and assortment," in Proc. of the Int. Conf. on Artificial Intelligence (IC-AI'04). Las Vegas, Nevada, USA, June 21-24, H. Arabnia, Ed., vol. I. CSREA Press, 2004, pp. 228-234.
18. M. Kubat, R. C. Holte, and S. Matwin, "Machine learning for the detection of oil spills in satellite radar images," Machine Learning, vol. 30(2-3), pp. 195-215, 1998.
19. S. Lessmann, "Solving imbalanced classification problems with support vector machines," in Proc. of the Int. Conf. on Artificial Intelligence (IC-AI'04), Las Vegas, Nevada, USA, June 21-24, H. Arabnia, Ed., vol. I. CSREA Press, 2004, pp. 214-220.
20. V. Nissen, Evolutionäre Algorithmen : Darstellung, Beispiele, betriebswirtschaftliche Anwendungsmöglichkeiten. Wiesbaden: Dt. Univ.-Verl., 1994.
21. -, Einführung in Evolutionäre Algorithmen : Optimierung nach dem Vorbild der Evolution. Braunschweig: Vieweg, 1997.
22. N. Japkowicz and S. Stephen, "The Class Imbalance Problem: A Systematic Study," Intelligent Data Analysis, vol. 6(5), pp. 429-450, 2002.
23. D. Pyle, Data preparation for data mining. San Francisco: Morgan Kaufmann, 1999.
24. M. J. Berry and G. Linoff, Data mining techniques : for marketing, sales and customer relationship management, 2nd ed. New York: Wiley, 2004.
25. S. F. Crone, S. Lessmann, and R. Stahlbock, "Empirical comparison and evaluation of classifier performance for data mining in customer relationship management," in Proc. of IEEE 2004 International Joint Conference on Neural Networks (IJCNN 2004), Budapest, Hungary, July 25-29, D. Wunsch, Ed., vol. 1. IEEE, 2004, pp. 443-448.
26. S. S. Keerthi and C.-J. Lin, "Asymptotic behaviours of support vector machines with gaussian kernel," Neural Computation, vol. 15, pp. 1667-1689, 2003.