Generalised bottom-up pruning: A model level combination of decision trees

Expert Systems with Applications

Volumn 39, Issue 10, 2012, Pages 9150-9158

  Eastwood, Mark ^a   Gabrys, Bogdan ^a  

^a BOURNEMOUTH UNIVERSITY   (United Kingdom)

Author keywords

Churn prediction; Decision tree pruning; Ensemble methods

Indexed keywords

BOTTOM UP; COMBINATION METHOD; DATA SETS; DECISION TREE PRUNING; DECISION TREES (DTS); ENSEMBLE METHODS; GENERALISATION; NATURAL EXTENSION; PREDICTION PROBLEM; SUBTREES;

TREES (MATHEMATICS);

DECISION TREES;

EID: 84859216442     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.02.061     Document Type: Article

References (29)

1. R.E. Banfield, L.O. Hall, K.W. Bowyer, and W.P. Kegelmeyer A comparison of decision tree ensemble creation techniques IEEE Transactions on Pattern Analysis and Machine Intelligence 29 2007 173 180
2. L. Breiman Random forests Machine Learning 45 1 2001 5 32
3. Breiman, L.; Friedman, J.; Olshen, R.; Stone, C. (1984). Classification and regression trees. Wadsworth and Brooks, Monterey, CA, 1984. New edition.
4. P. Domingos Knowledge discovery via multiple models Intelligent Data Analysis 2 1998 187 202
5. Duin, R. P. W.; de Ridder, D. PRtools, a matlab toolbox for pattern recognition. .
6. Eastwood, M.; Gabrys, B. (2009). A non-sequential representation of sequential data for churn prediction. In 13th International conference on knowledge-based and intelligent information and engineering systems, pp. 209-218.
7. F. Esposito, D. Malerba, and G. Semeraro A comparative analysis of methods for pruning decision trees IEEE Transactions on Pattern Analysis and Machine Intelligence 19 5 1997 476 491
8. C. Ferri, J. Hernández-Orallo, and M.J. Ramírez-Quintana From ensemble methods to comprehensible models DS '02: Proceedings of the 5th International Conference on Discovery Science 2002 Springer-Verlag London, UK 165 177
9. B. Gabrys Learning hybrid neuro-fuzzy classifier models from data: To combine or not to combine? Fuzzy Sets and Systems 147 2004 39 56
10. Hall, M. (1998). Combining particles and waves for fluid animation. Technical Report TR92-185, 25.
11. D. Jensen, and P.R. Cohen Multiple comparisons in induction algorithms Machine Learning 38 2000 309 338
12. Jensen, D.; Schmill, M. D. (1997). Adjusting for multiple comparisons in decision tree pruning. In Proceedings of third international conference on knowledge discovery and data mining, pp. 195-198.
13. M. Kearns, and Y. Mansour A fast, bottom-up decision tree pruning algorithm with near-optimal generalization Proceedings of the 15th International Conference on Machine Learning 1998 Morgan Kaufmann 269 277
14. L.I. Kuncheva Combining pattern classifiers: Methods and algorithms 2004 Wiley-Interscience
15. G.R.G. Lanckriet, N. Cristianini, P. Bartlett, L. EL Ghaoui, and M.I. Jordan Learning the kernel matrix with semidefinite programming Journal of Machine Learning Research 5 2004 27 72
16. Lee, S. W.; Verzakov, S.; Duin, R. P. (2007). Kernel combination versus classifier combination. In Proceedings of the seventh international workshop on multiple classifier systems, pp. 22-31.
17. M. Mehta, J. Rissanen, and R. Agrawal MDL-based decision tree pruning Proceedings of 1st International Conference on Knowledge Discovery and Data Mining 1995 AAAI Press 216 221
18. J. Mingers Expert systems-rule induction with statistical data The Journal of the Operational Research Society 38 1 1987 39 47
19. T. Niblett, and I. Bratko Learning decision rules in noisy domains Proceedings of the sixth Annual Technical Conference on Research and development in Expert Systems 1987 Cambridge University Press 25 34
20. C. Nugent, and P. Cunningham A case-based explanation system for black-box systems Artificial Intelligence Review 24 2005 163 178
21. J.R. Quinlan Simplifying decision trees International Journal of Man-Machine Studies 27 1987 221 234
22. J.R. Quinlan, and R.L. Rivest Inferring decision trees using the minimum description length principle Information and Computation 80 3 1989 227 248
23. L. Rokach Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography Computational Statistics & Data Analysis 53 12 2009 4046 4072
24. Ruta, D.; Nauck, D.; Azvine, B. (2006). K nearest sequence method and its application to churn prediction. In Proceedings of seventh international conference on intelligent data engineering and automated learning, pp. 207-215.
25. R. Schapire, Y. Freund, P. Bartlett, and W.S. Lee Boosting the margin: A new explanation of the effectiveness of voting methods The Annals of Statistics 26 5 1998 1651 1686
26. Utans, J. (1996). Weight averaging for neural networks and local resampling schemes. In Proceedings of the AAAI-96 workshop on integrating multiple learned models for improving and scaling machine learning algorithms, pp. 133-138.
27. C. Wei, and I. Chiu Turning telecommunications call details to churn prediction: A data mining approach Expert Systems with Applications 23 2002 103 112
28. Yan, L.; Miller, D. J.; Mozer, M. C.; Wolniewicz, R. (2001). Improving prediction of customer behaviour in non-stationary environments. In Proceedings of international joint conference on neural networks, pp. 2258-2263.
29. J. Zurada Could decision trees improve the classification accuracy and interpretability of loan granting decisions? Proceedings of the Hawaii International Conference on System Sciences 2010 IEEE Computer Society Los Alamitos, CA, USA 1 9