Many are better than one: Improving probabilistic estimates from decision trees

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3944 LNAI, Issue , 2006, Pages 41-55

  Chawla, Nitesh V ^a  

^a University of Notre Dame   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER SYSTEMS; DATA REDUCTION; PARAMETER ESTIMATION; PROBABILISTIC LOGICS; QUALITY CONTROL;

DECISION TREES; FREQUENCY-BASED ESTIMATES; PROBABILISTIC DECISION TREES; PROBABILISTIC ESTIMATES;

TREES (MATHEMATICS);

EID: 33745855879     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11736790_4     Document Type: Conference Paper

References (34)

1. [BFOS84] L. Breiman, J.H. Friedman, R.A. Olshen, and P.J. Stone. Classification and Regression Trees. Wadsworth International Group, Belmont, CA, 1984.
2. [BK99] E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting and variants. Machine Learning, 36(1,2), 1999.
3. [BM98] C.L. Blake and C. J. Merz. UCI Repository of Machine Learning Databases http://www.ics.uci.edu/~mlearn/~MLRepository.html. Department of Information and Computer Sciences, University of California, Irvine, 1998.
4. [Bra97] A. P. Bradley. The Use of the Area Under the ROC Curve in the Evaluation of Machine Learning Algorithms. Pattern Recognition, 30(6):1145-1159, 1997.
5. [Bre96] L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
6. [CHKK02] N.V. Chawla, L.O. Hall, Bowyer K.W., and W.P. Kegelmeyer. SMOTE: Synthetic Minority Oversampling TEchnique. Journal of Artificial Intelligence Research, 16:321-357, 2002.
7. [Coh95] W. Cohen. Learning to Classify English Text with ILP Methods. In Proceedings of the 5th International Workshop on Inductive Logic Programming, pages 3-24. Department of Computer Science, Katholieke Universiteit Leuven, 1995.
8. [Cus93] J. Cussents. Bayes and pseudo-bayes estimates of conditional probabilities and their reliabilities. In Proceedings of European Conference on Machine Learning, 1993.
9. [DB98] B. Draper and K. Baek. Bagging in computer vision. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 144-149, 1998.
10. [Die00] T. Dietterich. An empirical comparison of three methods for constructing ensembles of decision trees: bagging, boosting and randomization. Machine Learning, 40(2):139 - 157, 2000.
11. [Dom97] P. Domingos. Why does bagging work? a bayesian account and its implications. In Proceedings of Third International Conference Knowledge Discovery and Data Mining, pages 155-158, 1997.
12. [DPHS98] S. Dumais, J. Platt, D. Heckerman, and M. Sahami. Inductive Learning Algorithms and Representations for Text Categorization. In Proceedings of the Seventh International Conference on Information and Knowledge Management., pages 148-155, 1998.
13. [ESN96] J. Ezawa, K., M. Singh, and W. Norton, S. Learning Goal Oriented Bayesian Networks for Telecommunications Risk Management. In Proceedings of the International Conference on Machine Learning, ICML-96, pages 139-147, Bari, Italy, 1996. Morgan Kauffman.
14. [FK93] U. Fayyad and R. Kohavi. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of 13th International Joint Conference on Artificial Intelligence, pages 1022-1027, 1993.
15. [FP96] T. Fawcett and F. Provost. Combining Data Mining and Machine Learning for Effective User Profile. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, pages 8-13, Portland, OR, 1996. AAAI.
16. [GF83] M. Do Groot and S. Fionberg. The Comparison und Evaluation of Forecasters. Statistician, 32:12 - 22, 1983.
17. [Ho98] T. K. Ho. The random subspace method for constructing decision trees. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
18. [JS02] N. Japkowicz and S. Stephen, The class imbalance problem: A systematic study. Intelligent Data Analysis, 6(5), 2002.
19. [KHM98] M. Kubat, R. Holte, and S. Matwin. Machine Learning for the Detection of Oil Spills in Satellite Radar Images. Machine Learning, 30:195-215, 1998.
20. [KW03] L. Kuncheva and C. Whitaker. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51:181-207, 2003.
21. [LR94] D. Lewis and M. Ringuette. A Comparison of Two Learning Algorithms for Text Categorization. In Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval, pages 81-93, 1994.
22. [MG09] D. Mladenić and M. Grobelnik, Feature Selection for Unbalanced Class Distribution and Naive Bayes, In Proceedings of the 16th International Conference on Machine Learning., pages 258-267, Morgan Kaufmann, 1990.
23. [Min91] M. Minsky. Logical versus analogical, symbolic versus connectionist, neat versus scruffy. AI Magazine, 12, 1991.
24. [PD03] F. Provost and P. Domingos, Tree induction for probability-based rankings, Machine Learning, 52(3), 2003.
25. [PFK98] F. Provost, T. Fawcett, and R. Kohavi. The Case Against Accuracy Estimation for Comparing Induction Algorithms. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 445-453, Madison, WI, 1998. Morgan Kauffrnann.
26. [PMM+94] M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk. Reducing misclassification costs, In Proceedings of the Eleventh International Conference on Machine Learning, pages 217-215, 1994.
27. [QC05] Joaquin Quiñonero-Candela. Evaluating Predictive Uncertainty Challenge, 2005. predict.kyb.tuebingen.mpg.de.
28. [Qui87] J.R. Quinlan. Simplifying decision trees. International Journal of Man Machine Studies, V.27, pages 227-248, 1987.
29. [Qui92] J.R. Quinlan. C4-5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1992.
30. [Qui96] J. R. Quinlan. Bagging, boosting, and C4.5. In Proceedings of the Thirteenth National Conference on Artificial Intelligence, pages 725-730, 1996.
31. [SC05] J. Sylvester and N. V. Chawla. Evolutionary ensembles: Combining learning agents using genetic algorithms. In AAAI Workshop on Multiagent Learning, pages 46-51, 2005.
32. [SGF95] P. Smyth, A. Gray, and U. Fayyad. Retrofitting decision tree classifiers using kernel density estimation. In Proceedings of the Twelth International Conference on Machine Learning, pages 506-514, 1995.
33. [WDB+93] K. Woods, C. Doss, K. Bowyer, J. Solka, C. Priebe, and P. Kegelmeyer. Comparative Evaluation of Pattern Recognition Techniques for Detection of Microcalcifications in Mammography. International Journal of Pattern Recognition and Artificial Intelligence, 7(6):1417-1436, 1993.
34. [ZE01] B. Zadrozny and C. Elkan. Learning and making decisions when costs and probabilities are both unknown. In Proceedings of the Seventh International Conference on Knowledge Discovery and Data Mining, 2001.