Parameter optimization in decision tree learning by using simple genetic algorithms

WSEAS Transactions on Computers

Volumn 13, Issue , 2014, Pages 582-591

  Camilleri, Michel ^a   Neri, Filippo ^b  

^a UNIVERSITY OF MALTA   (Malta)

^b UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

Evolutionary algorithms; Machine learning; Parameter optimization

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA MINING; DECISION TREES; EVOLUTIONARY ALGORITHMS; GENETIC ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

COMBINATORIAL PROBLEM; DECISION TREE LEARNING; OPTIMAL PARAMETER; OPTIMAL PARAMETER SETTINGS; OPTIMIZATION ALGORITHMS; PARAMETER OPTIMIZATION; PARAMETER SET; SIMPLE GENETIC ALGORITHM;

PARAMETER ESTIMATION;

EID: 84912025963     PISSN: 11092750     EISSN: 22242872     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. C. Blum and A. Roli, Metaheuristics in combinatorial optimization: Overview and conceptual comparison, ACM Computing Surveys, 2003, 35(3),pp. 268-308.
2. D. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison- Wesley, Reading, Ma, 1989.
3. K. A. Smith-Miles, Cross-disciplinary perspectives on meta-learning for algorithm selection, ACM Computing Surveys, 41(1),2009,pp. 6:1- 6:25.
4. M. Reif, F. Shafait, and A. Dengel, Metalearning for evolutionary parameter optimization of classifiers, Machine Learning, 87(3), 2012,pp. 357-380.
5. M. E. H. Pederson and A. J. Chipperfield, Simplifying particle swarm optimization, Applied Soft Computing, 10, 2009,pp. 618-628.
6. J. J. Grefenstette, Optimization of control parameters for genetic algorithms, IEEE Transactions on Systems, Man, and Cybernetics, 16(1),1986,pp. 122 128.
7. A.S. Staines,F. Neri,A Matrix Transition Oriented Net for Modeling Distributed Complex Computer and Communication Systems, WSEAS Transactions on Systems, 13, WSEAS Press (Athens, Greece),2014,pp. 12-22.
8. F. Neri, A comparative study of a financial agent based simulator across learning scenarios, In ADMI 2011 Agent and Data Mining Interaction, volume LNAI 7103, Springer, 2012,pp. 86-97.
9. F. Hutter, H. H. Hoos, K. Leyton-Brown, and T. Stuutzle, Paramils:an automatic algorithm configuration framework, Journal of Artificial Intelligence Research (JAIR), 36,2009,pp. 267-306.
10. D. Wolpert, W.G. Macready,No Free Lunch Theorems for Optimization, IEEE Transactions on Evolutionary Computation, April 1997,1(1),1997,pp. 67-82.
11. M. Camilleri, F. Neri, and M. Papoutsidakis, An Algorithmic Approach to Parameter Selection in Machine Learning using Meta- Optimization Techniques, WSEAS Transactions on Systems,WSEAS Press (Athens, Greece), 13,2014,pp. 202-213.
12. nd International Conference on Acoustics, Speech and Audio Processing (ASAP '14), Salerno, Italy, 2014, Editors F. Neri C. Guarnaccia, WSEAS Press(Athens, Greece),2014
13. M. Papoutsidakis,D. Piromalis, F. Neri,M. Camilleri,Intelligent Algorithms Based on Data Processing for Modular Robotic Vehicles Control, WSEAS Transactions on Systems, 13, WSEAS Press (Athens, Greece),2014,pp. 242-251.
14. J. R. Quinlan, Induction of decision trees, Machine Learning, 1(1), 1986,pp. 81-106.)
15. H.B. Alwan,K.R. Ku-Mahamud,Solving SVM Model Selection Problem using ACOR and IACOR, WSEAS Transactions on Computers,WSEAS Press (Athens,Greece), 13,2014,pp. 277-288.
16. M.A. Ahandani,M.T.V. Baghmisheh, Hybridizing Genetic Algorithms and Particle Swarm Optimization Transplanted into a Hyper-Heuristic System for Solving University Course Timetabling Problem, WSEAS Transactions on Computers,WSEAS Press (Athens,Greece),3(13),2013,pp. 128-143.
17. J. Magalhaes-Mendes,A Comparative Study of Crossover Operators for Genetic Algorithms to Solve the Job Shop Scheduling Problem, WSEAS Transactions on Computers,WSEAS Press (Athens,Greece), 4(12),2013,pp. 164-173.
18. A. E. Eiben, R. Hinterding, and Z. Michalewicz, Parameter control in evolutionary algorithms, IEEE Transactions on Evolutionary Computation, 3(2),1999,pp. 124-141.
19. A. E. Eiben and S. K. Smit, Parameter tuning for configuring and analyzing evolutionary algorithms, Swarm and Evolutionary Computation, 1(1), 2011,pp. 19-31.
20. M. Birattari,T. Stutzle,L. Paquete,K. Varrentrapp, A Racing Algorithm for Configuring Metaheuristics, GECCO 2002: Proceedings of the Genetic and Evolutionary Computation Conference, Morgan Kaufmann Publishers, 2002,pp. 11-18.
21. O. Maron,A.W. Moore,The Racing Algorithm: Model Selection for Lazy Learners, Artificial Intelligence Review,(11),1997,pp. 193-225.
22. th International Workshop on Hybrid Metaheuristics, Proceedings, HM 2007,4771 of Lecture Notes in Computer Science, Springer Verlag, Berlin, Germany,2007,pp. 108-122.
23. M. Lopez-Ibanez, J. Dubois-Lacoste,T. Stutzle, M. Birattari,The Irace package, Iterated Race for Automatic Algorithm Configuration, IRIDIA, Universit é Libre de Bruxelles, Belgium, TR/IRIDIA/2011-004, url= http://iridia.ulb.ac.be/IridiaTrSeries/IridiaTr2011-004.pdf, 2011.
24. J. Bergstra,Y. Bengio,Random Search for Hyper- Parameter Optimization, Journal of Machine Learning Research, 13,(feb),2012,pp. 281-305.
25. C. Neumiller, S. Wagner, G. Kronberger, and M. Affenzeller, Parameter meta-optimization of metaheuristic optimization algorithms, In Moreno-Daz, R., Pichler, F. & Quesada- Arencibia, A. (Eds.), Computer Aided Systems Theory EUROCAST 2011, Vol. 6927 of Lecture Notes in Computer Science Springer Berlin Heidelberg, 2012,pp. 367-374.
26. A. Kumar,S. Kumar,Decision Tree Based Learning Approach for Identification of Operating System Processes, WSEAS Transactions on Computers,WSEAS Press (Athens,Greece), 13,2014,pp. 277-288.
27. A. Frank and A. Asuncion, UCI Machine Learning Repository, http://archive.ics.uci.edu/ml, 2010.
28. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, The weka data mining software: An update, SIGKDD Explorations, 11(1), 2009.
29. Z. Michalewicz, Genetic algorithms + data structures = evolution programs, Springer, 1996.
30. D. Michie, D. Spiegelhalter, and C. Taylor, Machine learning, neural and statistical classification, New York:Ellis Horwood,1994.