Evtree: Evolutionary learning of globally optimal classification and regression trees in R

Journal of Statistical Software

Volumn 61, Issue 1, 2014, Pages 1-29

  Grubinger, Thomas ^a   Zeileis, Achim ^b   Pfeiffer, Karl Peter ^a  

^a INNSBRUCK MEDICAL UNIVERSITY   (Austria)

^b UNIVERSITY OF INNSBRUCK   (Austria)

Author keywords

Classification trees; Evolutionary algorithms; Machine learning; R; Regression trees

Indexed keywords

EID: 84908230264     PISSN: 15487660     EISSN: None     Source Type: Journal    
DOI: 10.18637/jss.v061.i01     Document Type: Article

References (55)

1. Bache K, Lichman M (2013). "UCI Machine Learning Repository." URL http://archive.ics.uci.edu/ml/.
2. Bäck T (1996). Evolutionary Algorithms in Theory and Practice. Oxford University Press, New York.
3. Barros RC, Basgalupp MP, de Carvalho A, Freitas AA (2012). "A Survey of Evolutionary Algorithms for Decision-Tree Induction." IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 42(3), 291-312.
4. Breiman L (2001). "Random Forests." Machine Learning, 45(1), 5-32.
5. Breiman L, Friedman JH, Olshen RA, Stone CJ (1984). Classification and Regression Trees. Wadsworth, Belmont.
6. Bundesministerium für Gesundheit (2010). "The Austrian DRG System." URL: http://www.bmg.gv.at/home/EN/Topics/The_Austrian_DRG_system_brochure (accessed on 2014-08-09).
7. Cano JR, Herrera F, Lozano M (2003). "Using Evolutionary Algorithms as Instance Selection for Data Reduction in KDD: An Experimental Study." IEEE Transactions on Evolutionary Computation, 7(6), 561-575.
8. Cantu-Paz E, Kamath C (2003). "Inducing Oblique Decision Trees with Evolutionary Algorithms." IEEE Transactions on Evolutionary Computation, 7(1), 54-68.
9. Caruana R, Niculescu-Mizil A (2006). "An Empirical Comparison of Supervised Learning Algorithms." In Proceedings of the 23rd International Conference on Machine learning, pp. 161-168. ACM Press, New York.
10. Chambers JM (2008). Software for Data Analysis: Programming with R. Springer-Verlag, New York.
11. de Mazancourt C, Calcagno V (2010). "Glmulti: An R Package for Easy Automated Model Selection with (Generalized) Linear Models." Journal of Statistical Software, 34(12), 1-29. URL http://www.jstatsoft.org/v34/i12/.
12. Denison DGT, Mallick BK, Smith AFM (1998). "A Bayesian CART Algorithm." Biometrika, 85(2), 363-377.
13. Eiben AE, Smith JE (2007). Introduction to Evolutionary Computing. Springer-Verlag, New York.
14. Esmeir S, Markovitch S (2007). "Anytime Learning of Decision Trees." Journal of Machine Learning Research, 8, 891-933.
15. Espejo PG, Ventura S, Herrera F (2010). "A Survey on the Application of Genetic Programming to Classification." IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 40(2), 121-144.
16. Fan G, Gray JB (2005). "Regression Tree Analysis Using TARGET." Journal of Computational and Graphical Statistics, 14(1), 206-218.
17. Fogel LJ, Owens AJ, Walsh MJ (1966). Artificial Intelligence through Simulated Evolution. John Wiley & Sons, New York.
18. Freitas AA (2003). "A Survey of Evolutionary Algorithms for Data Mining and Knowledge Discovery." In A Ghosh, S Tsutsui (eds.), Advances in Evolutionary Computing, pp. 819-845. Springer-Verlag, New York.
19. Gray JB, Fan G (2008). "Classification Tree Analysis Using TARGET." Computational Statistics & Data Analysis, 52(3), 1362-1372.
20. Grubinger T, Kobel C, Pfeiffer KP (2010). "Regression Tree Construction by Bootstrap: Model Search for DRG-Systems Applied to Austrian Health-Data." BMC Medical Informatics and Decision Making, 10(9).
21. Hastie T, Tibshirani R, Friedman J (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd edition. Springer-Verlag, New York.
22. Holland JH (1992). Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press, Cambridge.
23. Hornik K, Buchta C, Zeileis A (2009). "Open-Source Machine Learning: R Meets Weka." Computational Statistics, 24(2), 225-232.
24. Hothorn T (2014). "CRAN Task View: Machine Learning." Version 2014-08-08, URL http://CRAN.R-project.org/view=MachineLearning.
25. Hothorn T, Bretz F, Westfall P (2008). "Simultaneous Inference in General Parametric Models." Biometrical Journal, 50(3), 346-363.
26. Hothorn T, Hornik K, Zeileis A (2006). "Unbiased Recursive Partitioning: A Conditional Inference Framework." Journal of Computational and Graphical Statistics, 15(3), 651-674.
27. Hothorn T, Leisch F, Zeileis A, Hornik K (2005). "The Design and Analysis of Benchmark Experiments." Journal of Computational and Graphical Statistics, 14(3), 675-699.
28. Hothorn T, Zeileis A (2014). "Partykit: A Modular Toolkit for Recursive Partytioning in R." Working Paper 2014-10, Working Papers in Economics and Statistics, Research Platform Empirical and Experimental Economics, Universität Innsbruck. URL http://EconPapers.RePEc.org/RePEc:inn:wpaper:2014-10.
29. Hyafil L, Rivest RL (1976). "Constructing Optimal Binary Decision Trees Is NP-Complete." Information Processing Letters, 5(1), 15-17.
30. Jensen MT (2003). "Generating Robust and Flexible Job Shop Schedules Using Genetic Algorithms." IEEE Transactions on Evolutionary Computation, 7(3), 275-288.
31. Karatzoglou A, Smola A, Hornik K, Zeileis A (2004). "Kernlab - An S4 Package for Kernel Methods in R." Journal of Statistical Software, 11(9), 1-20. URL http://www.jstatsoft.org/v11/i09/.
32. Kooperberg C, Ruczinski I (2013). LogicReg: Logic Regression. R package version 1.5.5, URL http://CRAN.R-project.org/package=LogicReg.
33. Koza JR (1991). "Concept Formation and Decision Tree Induction Using the Genetic Programming Paradigm." In Proceedings of the 1st Workshop on Parallel Problem Solving from Nature, pp. 124-128. Springer-Verlag, London.
34. Koza JR (1992). Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge.
35. Leisch F, Dimitriadou E (2012). Mlbench: Machine Learning Benchmark Problems. R pack- age version 2.1-1, URL http://CRAN.R-project.org/package=mlbench.
36. Lilien GL, Rangaswamy A (2004). Marketing Engineering: Computer-Assisted Marketing Analysis and Planning. 2nd edition. Trafford Publishing, Victoria.
37. Loh WY (2009). "Improving the Precision of Classification Trees." Annals of Applied Statistics, 3(4), 1710-1737.
38. Mahfoud SW (1992). "Crowding and Preselection Revisited." Parallel Problem Solving from Nature, 2, 27-36.
39. Man KF, Tang KS, Kwong S, Halang WA (1997). Genetic Algorithms for Control and Signal Processing. Springer-Verlag, New York.
40. Michalewicz Z (1994). Genetic Algorithms Plus Data Structures Equals Evolution Programs. Springer-Verlag, New York.
41. Murthy SK, Salzberg S (1995). "Decision Tree Induction: How Effective Is the Greedy Heuris- tic?" In UM Fayyad, R Uthurusamy (eds.), Proceedings of the First International Confer- ence on Knowledge Discovery and Data Mining, pp. 222-227. AAAI Press, San Mateo.
42. Papagelis A, Kalles D (2001). "Breeding Decision Trees Using Evolutionary Techniques." In CE Brodley, AP Danyluk (eds.), Proceedings of the Eighteenth International Conference on Machine Learning, pp. 393-400. Morgan Kaufmann Publishers, San Mateo.
43. Quinlan JR (1992). "Learning with Continuous Classes." In Proceedings of the 5th Australian Joint Conference on Artificial Intelligence, pp. 343-348. World Scientific.
44. Quinlan JR (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo.
45. Quinlan JR, Rivest RL (1989). "Inferring Decision Trees Using the Minimum Description Length Principle." Information and Computation, 80(3), 227-248.
46. R Core Team (2014). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. URL http://www.R-project.org/.
47. Rechenberg I (1973). Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution. Frommann-Holzboog Verlag, Stuttgart.
48. Ripley BD (2008). Pattern Recognition and Neural Networks. Cambridge University Press, Cambridge.
49. Scrucca L (2013). "GA: A Package for Genetic Algorithms in R." Journal of Statistical Software, 53(4), 1-37. URL http://www.jstatsoft.org/v53/i04/.
50. Sutton CD (1991). "Improving Classification Trees with Simulated Annealing." In EM Kerami- das, SM Kaufman (eds.), Computing Science and Statistics: Proceedings of the 23rd Sympo- sium on the Interface, pp. 333-344. Interface Foundation of North America, Fairfax Station.
51. Therneau TM, Atkinson EJ (1997). An Introduction to Recursive Partitioning Using the rpart Routine. Technical Report 61, Section of Biostatistics, Mayo Clinic, Rochester. URL http://www.mayo.edu/hsr/techrpt/61.pdf.
52. Vapnik VN (1995). The Nature of Statistical Learning Theory. Springer-Verlag, New York.
53. Witten IH, Frank E (2011). Data Mining: Practical Machine Learning Tools and Techniques. 3rd edition. Morgan Kaufmann Publishers, San Francisco.
54. Zantema H (2000). "Finding Small Equivalent Decision Trees Is Hard." International Journal of Foundations of Computer Science, 11(2), 343-354.
55. Zeileis A, Hothorn T, Hornik K (2008). "Model-Based Recursive Partitioning." Journal of Computational and Graphical Statistics, 17(2), 492-514.