Evaluating probability estimates from decision trees

AAAI Workshop - Technical Report

Volumn WS-06-06, Issue , 2006, Pages 18-23

  Chawla, Nitesh V ^a   Cieslak, David A ^a  

^a University of Notre Dame   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION TREES; PROBABILITY ESTIMATES; SYSTEMATIC BIAS;

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); DECISION THEORY; LAPLACE TRANSFORMS; PROBABILITY;

TREES (MATHEMATICS);

EID: 33846081827     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Bauer, E., and Kohavi, R. 1999. An empirical comparison of voting classification algorithms: Bagging, boosting and variants. Machine Learning 36(1, 2).
2. Bradley, A. P. 1997. The Use of the Area Under the ROC Curve in the Evaluation of Machine Learning Algorithms. Pattern Recognition 30(6):1145-1159.
3. Breiman, L. 1996. Bagging predictors. Machine Learning 24(2):123-140.
4. Candella, J. 2004. Evaluating Predictive Uncertainty Challenge, NIPS 2004.
5. Chawla, N.; Hall, L.; Bowyer, K.; and Kegelmeyer, W. 2002. SMOTE: Synthetic Minority Oversampling TEchnique. Journal of Artificial Intelligence Research 16:321-357.
6. Cohen, W. 1995. Learning to Classify English Text with ILP Methods. In Proceedings of the 5th International Workshop on Inductive Logic Programming, 3-24. Department of Computer Science, Katholieke Universiteit Leuven.
7. Cussens, J. 1993. Bayes and pseudo-bayes estimates of conditional probabilities and their reliabilities. In Proceedings of European Conference on Machine Learning.
8. DeGroot, M., and Fienberg, S. 1983. The Comparison and Evaluation of Forecasters. Statistician 32:12 - 22.
9. Domingos, P., and Pazzani, M. J. 1996. Beyond independence: Conditions for the optimality of the simple bayesian classifier. In International Conference on Machine Learning, 105-112.
10. Dumais, S.; Platt, J.; Heckerman, D.; and Sahami, M. 1998. Inductive Learning Algorithms and Representations for Text Categorization. In Proceedings of the Seventh International Conference on Information and Knowledge Management., 148-155.
11. Ezawa, K., J.; Singh, M.; and Norton, S., W. 1996. Learning Goal Oriented Bayesian Networks for Telecommunications Risk Management. In Proceedings of the International Conference on Machine Learning, ICML-96, 139-147. Bari, Italy: Morgan Kauffman.
12. Fawcett, T., and Provost, F. 1996. Combining Data Mining and Machine Learning for Effective User Profile. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, 8-13. Portland, OR: AAAI.
13. Ferri, C.; Flach, P. A.; and Hernandez-Orallo, J. 2003. Improving the auc of probabilistic estimation trees. In European Conference on Machine Learning, 121-132.
14. Japkowicz, N., and Stephen, S. 2002. The class imbalance problem: A systematic study. Intelligent Data Analysis 6(5).
15. Kubat, M.; Holte, R.; and Matwin, S. 1998. Machine Learning for the Detection of Oil Spills in Satellite Radar Images. Machine Learning 30:195-215.
16. Margineantu, D., and Dietterich, T. 2001. Improved class probability estimates from decision tree models. In Nonlinear Estimation and Classification, 169-184.
17. Mladenić, D., and Grobelnik, M. 1999. Feature Selection for Unbalanced Class Distribution and Naive Bayes. In Proceedings of the 16th International Conference on Machine Learning., 258-267. Morgan Kaufmann.
18. Niculescu-Mizil, A., and Caruana, R. 2005. Predicting good probabilities with supervised learning. In International Conference on Machine Learning, 625-632.
19. Pazzani, M.; Merz, C.; Murphy, P.; Ali, K.; Hume, T.; and Brunk, C. 1994. Reducing misclassification costs. In Proceedings of the Eleventh International Conference on Machine Learning, 217-215.
20. Provost, F., and Domingos, P. 2003. Tree induction for probability-based rankings. Machine Learning 52(3).
21. Provost, F., and Fawcett, T. 2001. Robust Classification for Imprecise Environments. Machine Learning 42/3:203-231.
22. Quinlan, J. 1992. C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann.
23. Smyth, P.; Gray, A.; and Fayyad, U. 1995. Retrofitting decision tree classifiers using kernel density estimation. In Proceedings of the Twelth International Conference on Machine Learning, 506-514.
24. Zadrozny, B., and Elkan, C. 2001. Learning and making decisions when costs and probabilities are both unknown. In Proceedings of the Seventh International Conference on Knowledge Discovery and Data Mining.