Decision-tree instance-space decomposition with grouped gain-ratio

Information Sciences

Volumn 177, Issue 17, 2007, Pages 3592-3612

  Cohen, Shahar ^a   Rokach, Lior ^b   Maimon, Oded ^a  

^a TEL AVIV UNIVERSITY   (Israel)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Classification; Decision trees; Instance space decomposition; Multiple classifier systems

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL METHODS;

INSTANCE SPACE DECOMPOSITION; MULTIPLE CLASSIFIER SYSTEMS; SPLITTING RULES;

DECISION TREES;

EID: 34250314887     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2007.01.016     Document Type: Article

References (41)

1. Bauer E., and Kohavi R. An empirical comparison of voting classification algorithms: bagging, boosting, and variants. Machine Learning 36 (1999) 105-139
2. Breiman L. Bagging predictors. Machine Learning 24 (1996) 123-140
3. Breiman L., Olshen J.H., and Stone C.J. Classification and Regression Trees (1984), Chapman Hall, New York
4. Brodley C.E. Recursive automatic bias selection for classifier construction. Machine Learning 20 (1995) 63-94
5. Carvalho D.R., and Freitas A.A. A hybrid decision-tree/genetic algorithm method for data mining. Information Science 163 (2004) 13-35
6. Dietterich T.G. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation 10 (1998) 1895-1923
7. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting and randomization. Machine Learning 40 (2000) 139-157
8. Esmeir S., and Markovitch S. Lookahead-based algorithms for anytime induction of decision trees. Proceedings of the Twenty-First International Conference on Machine Learning (2004), Morgan Kaufmann 257-264
9. Freund Y., and Schapire R. A short introduction to boosting. Journal of Japanese Society for Artificial Intelligence 14 (1999) 771-780
10. J. Fürnkranz, Round robin rule learning, in: Proc. of the 18th International Conference on Machine Learning, Williamstown, MA, 2001, pp. 146-153.
11. Fürnkranz J. Round robin ensembles. Intelligent Data Analysis 7 (2003) 385-403
12. Hampshire J.B., and Waibel A. The meta-pi network - building distributed knowledge representation for robust multisourse pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 14 (1992) 751-769
13. Hansen J.V. Combining predictors: comparison of five meta machine learning methods. Information Science 119 (1999) 91-105
14. Hansen L., and Salamon P. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (1990) 993-1001
15. M.B. Harries, K. Horn, Learning stable concepts in domains with hidden changes in context, in: M. Kubat, G. Widmer (Eds.), Learning in context-sensitive domains (Workshop Notes), 13th International Conference on Machine Learning, Bari, Itali, 1996, pp. 106-122.
16. Horton T., and Lausen B. Bundling classifiers by bagging trees. Computational Statistics and Data Analysis 49 (2005) 1068-1078
17. Jordan M.I., and Jacobs R.A. Hierarchical mixture of experts and the EM algorithm. Neural Computation 6 (1994) 181-214
18. R. Kohavi, Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid, in: Proc. of the 2nd International Conference on Knowledge Discovery and Data Mining, Portland, OR, 1996, pp. 202-207.
19. Kusiak A. Decomposition in data mining: an industrial case study. IEEE Transactions on Electronics Packaging Manufacturing 23 (2000) 345-353
20. O. Lezoray, H. Cardot, Combining multiple pairwise neural networks classifiers: a comparative study, in: International Workshop on Artificial Neural Networks and Intelligent Information Processing, Barcelona, Spain, 2005, pp. 52-61.
21. Maimon O., and Rokach L. Decomposition Methodology for Knowledge Discovery and Data Mining: Theory and Applications (2005), World Scientific
22. Mertz C.J. Dynamical selection of learning algorithms. In: Fisher C., and Lenz H. (Eds). Learning from Data: Artificial Intelligence and Statistics (1996), Springer-Verlag 281-290
23. Mertz C.J. Using correspondence analysis to combine classifiers. Machine Learning 36 (1999) 33-58
24. C.J. Mertz, P.M. Murphy, UCI repository of machine learning databases. .
25. Marthy S., and Salzberg S. Lookahead and pathology in decision tree induction. Proceedings of the 14 th International Joint Conference on Artificial Intelligence (1995), Morgan Kaufmann 1025-1031
26. S.J. Nowlan, G.E. Hinton, Evaluation of adaptive mixtures of competing experts, in: Advances of Neural Information Processing Systems 3, Denver CO, 1990, pp. 774-780.
27. Onho-Machado L., and Musen M.A. neural networks for medical prognosis: quantifying the benefits of combining neural networks for survival prediction. Connection Science 9 (1997) 71-86
28. Peng F., Jacobs R.A., and Tanner M.A. Bayesian inference in mixture-of-experts and hierarchical mixture-of-experts models with an application to speech recognition. Journal of the American Statistical Association 91 (1996) 953-960
29. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Morgan Kaufmann, San Francisco, CA
30. Rahman A.F.R., and Fairhurst M.C. A new hybrid approach in combining multiple experts to recognize handwritten numerals. Pattern Recognition Letters 18 (1997) 781-790
31. Sakar A., and Mammone R.J. Growing and pruning neural tree networks. IEEE Transactions on Computers 42 (1993) 291-299
32. Salzberg S.L. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Mining and Knowledge Discovery 1 (1997) 317-328
33. P. Savicky, J. Fürnkranz, Combining pairwise classifiers with stacking, in: Advances on Intelligent Data Analysis V, Berlin, Germany, 2003, pp. 219-229.
34. Sharkey A.J.C. Multi-net systems. In: Sharkey A.J.C. (Ed). Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems (1999), Springer-Verlag 1-30
35. Warshall S. A theorem on Boolean matrices. Journal of the ACM 9 (1962) 11-12
36. Weigend A.S., Mangeas M., and Srivastava A.N. Nonlinear gated experts for time-series - discovering regimes and avoiding overfitting. International Journal of Neural Systems 6 (1995) 373-399
37. Witten I.H., and Frank E. Data Mining: Practical Machine Learning to OLS and Techniques. second ed. (2005), Morgan Kaufmann, San Francisco
38. Wolpert D.H. Stacked generalization. Neural Networks 5 (1992) 241-259
39. Zhou Z., Chen S., and Chen Z. FANNC: a fast adaptive neural network classifier. Knowledge and Information Systems 2 (2000) 115-129
40. Zhou Z., and Chen C. Hybrid decision tree. Knowledge-Based Systems 15 (2002) 515-528
41. Zupan B., Bohanec M., Demsar J., and Bratko I. Feature transformation by function decomposition. IEEE Intelligent Systems 13 (1998) 38-43