Elitist and ensemble strategies for cascade generalization

Journal of Database Management

Volumn 17, Issue 3, 2006, Pages 92-107

  Zhao, Huimin ^a   Sinha, Atish P ^a   Ram, Sudha ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Cascade generalization; Data mining; Decision tree; Elitist strategy; Ensemble method; Voting method

Indexed keywords

DATA MINING; DATA REDUCTION; DATABASE SYSTEMS; MATHEMATICAL MODELS; OPTIMIZATION;

CASCADE GENERALIZATION; DECISION TREES; ELITIST STRATEGY; ENSEMBLE METHOD; VOTING METHOD;

DECISION THEORY;

EID: 33846635390     PISSN: 10638016     EISSN: 15338010     Source Type: Journal    
DOI: 10.4018/jdm.2006070105     Document Type: Article

References (37)

1. Bauer, E., & Kohavi, R. (1999). Anempirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36(1-2), 105-139.
2. Bioch, J.C., van der Meer, O., & Potharst, R. (1997). Bivariate decision trees. In J. Komorowski, & J. Zytkow (Eds.), Principles of data mining and knowledge discovery: Lecture notes in artificial intelligence (pp. 232-243). London: Springer Verlag.
3. Blake, C.L., & Merz, C.J. (1998). UCI repository of machine learning databases. Retrieved from http://www.ics.uci.edu/~mlearn/ MLRepository.html
4. Breimaa, L. (1996). Bagging predictors. Machine Learning, 24(2), 123-140.
5. Bradley, C.E., & Utgoff, P.E. (1995). Multivariate decision trees. Machine Learning, 19(1), 45-77.
6. Cohen, J. (1977). Statistical power analysis for the behavioral sciences. Orlando, FL: Academic Press.
7. Dietterich, T.G. (2000). An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning, 40(2), 139-157.
8. Domingos, P. (2000). A unified bias-variance decomposition and its applications. Proceedings of the 17th International Conference on Machine Learning (pp. 231-238).
9. Doumpos, M., Kosmidou, K., Baourakis, G., & Zopounidis, C. (2002). Credit risk assessment using a multicriteria hierarchical discrimination approach: A comparative analysis. European Journal of Operational Research, 138(2), 392-412.
10. Freund, Y., & Schapire, R.E. (1996). Experiments with a new boosting algorithm. Proceedings of the 13th International Conference on Machine Learning (pp. 148-156).
11. Gama, J. (1999). Discriminant trees. Proceedings of the 16th International Conference on Machine Learning (pp. 134-142).
12. Gama, J., & Brazdil, P. (2000). Cascade generalization. Machine Learning, 41 (3), 315-343.
13. Geman, S., Bienenstock, E., & Doursat R. (1992). Neural networks and the bias/variance dilemma. Neural Computation, 4, 1-48.
14. Heath, D., Kasif, S., & Salzberg, S. (1993). Induction of oblique decision trees. Proceedings of the 13th International Joint Conference on Artificial Intelligence (pp. 1002-1007).
15. Hosmer, D.W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York: John Wiley & Sons.
16. Huang, Z., Chen, H., Hsu, C., Chen, W., & Wu, S. (2004). Credit rating analysis with support vector machines and neural networks: A market comparative study. Decision Support Systems, 37(4), 543-558.
17. John, G.H. (1996). Robust linear discriminant trees. In D. Fisher, & H. Lenz (Eds.), Learning from data: Artificial intelligence and statistics V: Lecture notes in statistics (pp. 375-385). New York: Springer-Verlag.
18. Kim, C.N., & McLeod, R. (1999). Expert, linear models, and nonlinear models of expert decision making in bankruptcy prediction: A lens model analysis. Journal of Management Information Systems, 16(1), 189-206.
19. Kohavi, R. (1995). A study of cross validation and bootstrap for accuracy estimation and model selection. Proceedings of the 14th International Joint Conference on Artificial Intelligence (pp. 1137-1143).
20. Kohavi, R., & Wolpert, D.H. (1996). Bias plus variance decomposition for zero-one loss functions. Proceedings of the 13th International Conference on Machine Learning (pp. 275-283).
21. Lam, M. (2004). Neural network techniques for financial performance prediction: Integrating fundamental and technical analysis. Decision Support Systems, 37(4), 567-581.
22. Murthy, S.K., Kasif, S., & Salzberg, S. (1994). A system for induction of oblique decision trees. Journal of Artificial Intelligence Research, 2, 1-32.
23. Osei-Bryson, K.-M., & Giles, K. (2004). An exploration of a set entropy-based hybrid splitting methods for decision tree induction. Journal of Database Management, 75(3), 1-17.
24. Quinlan, J.R. (1986). Induction of decision trees. Machine Learning, 7(1), 81-106.
25. Quinlan, J.R. (1993). C4.5: Programs for machine learning. San Mateo: Morgan Kaufmann.
26. Rajagopalan, B., & Krovi, R. (2002). Benchmarking data mining algorithms. Journal of Database Management, 13(1), 25-35.
27. Sarkar, S., & Sriram, R.S. (2001). Bayesian models for early warning of bank failures. Management Science, 47(11), 1457-1475.
28. Sinha, A.P., & May, J.H. (2005). Evaluating and tuning predictive data mining models using receiver operating characteristic curves. Journal of Management Information Systems, 27(3), 249-280.
29. Sung, T.K., Chang, N., & Lee, G. (1999). Dynamics of modeling in data mining: Interpretive approach to bankruptcy prediction. Journal of Management Information Systems, 16(1), 63-85.
30. Tam, K.Y., & Kiang, M.Y. (1992). Managerial applications of neural networks: The case of bank failure predictions. Management Science, 38(1), 926-947.
31. Weiss, S.M., & Kulikowski, C.A. (1991). Computer systems that learn - Classification and prediction methods from statistics, neural nets, machine learning, and expert system. San Mateo: Morgan Kaufmann.
32. Witten, I.H., & Frank, E. (2000). Data mining: Practical machine learning tools and techniques with Java implementation. San Francisco: Morgan Kaufmann.
33. Wolpert, D.H. (1994). The relationship between PAC, the statistical physics framework, the Bayesian framework, and the VC framework. Proceedings of the SFI/CNLS Workshop on Formal Approaches to Supervised Learning (pp. 117-214).
34. Yildiz, O.T., & Alpaydin, E. (2000). Linear discriminant trees. Proceedings of the 17th International Conference on Machine Learning (pp. 1175-1182).
35. Zhu, D., Premkumar, G., Zhang, X., & Chu, C. (2001). Data mining for network intrusion detection: A comparison of alternative methods. Decision Sciences, 32(4), 635-660.
36. Zhao, H., & Ram, S. (2004). Constrained cascade generalization of decision trees. IEEE Transactions on Knowledge and Data Engineering, 6(6), 727-739.
37. Zhao, H., & Sinha, A.P. (2005). An efficient algorithm for generating generalized decision forests. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 35(5) 754-762.