Improving the ranking performance of decision trees

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4212 LNAI, Issue , 2006, Pages 461-472

  Wang, Bin ^a   Zhang, Harry ^a  

^a UNIVERSITY OF NEW BRUNSWICK   (Canada)

Author keywords

AUC; Class probability; Decision tree; Ranking; Shrinkage; WPE

Indexed keywords

DATA STRUCTURES; LEARNING ALGORITHMS; PARAMETER ESTIMATION; PROBABILITY; STATISTICAL METHODS;

AREA UNDER THE RECEIVER OPERATING CHARACTERISTICS CURVE (AUC); CLASS PROBABILITY; DECISION TREE; WEIGHTED PROBABILITY ESTIMATION (WPE);

DECISION THEORY;

EID: 33750312217     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11871842_44     Document Type: Conference Paper

References (17)

1. Bahl, L., Brown, P., deSouza, P., Mercer, R.: A tree-based statistical language model for natural language speech recognition. IEEE Transactions on Acoustics, Speech and Signal Processing. (1989) bf 37, 1001-1008
2. Bauer, E., Kohavi, R.: An empirical comparison of voting classification algorithms: Bagging, boosting and variants. Artificial Intelligence 36 (1989) 105-142
3. Bradley, A. P.: The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30 (1997) 1145-1159
4. Buntine, W.: Learning classification trees. Artificial Intelligence frontiers in statistics. Chapman & Hall, London (1993) 182-201
5. Ferri, C., Flach, P. A., Hernandez-Orallo, J.: Improving the AUC of Probabilistic Estimation Trees. Proceedings of the 14th European Conference on Machine Learning (ECML2003). Springer (2003)
6. Hand, D. J., Till, R. J.: A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems. Machine Learning 45 (2001) 171-186
7. Hastie, T., Pregibon, L.: Shrinking Trees. AT & T Bell Laboratories (1990)
8. Ling, C. X., Huang, J., Zhang, H.: AUC: a statistically consistent and more discriminating measure than accuracy. Proceedings of 18th International Conference on Artificial Intelligence (IJCAI-2003). Morgan Kaufmann (2003) 329-341
9. Ling, C. X., Yan, R. J.: Decision tree with Better Ranking. Proceedings of the Twentieth International Conference on Machine Learning (ICML2003). AAAI Press (2003)
10. McCallum, A., Rosenfeld, R., Mitchell, T., Ng, A. Y.: Improving text classification by shrinkage in a hierarchy of classes. Proceedings of the 15th International Conference on Machine Learning. Morgan Kaufmann (1998) 359-367
11. Pazzani, M., Merz, C., Murphy, P., Ali, K., Hume, T., Bunk, C.: Reducing misclassification costs. Proceedings of the Eleventh International Conference on Machine Learning. Morgan Kaufmann (1994) 217-225
12. Provost, F., Domingos, P.: Tree Induction for Probability-based Ranking. Machine Learning. Kluwer Academic Publishers (2002)
13. Provost, F., Fawcett, T., Kohavi, R.: The case against accuracy estimation for comparing induction algorithms. Proceedings of the Fifteenth International Conference on Machine Learning. Morgan Kaufmann (1999) 445-453
14. Provost, F., Fawcett, T.: Analysis and visualization of classifier performance: Comparison under imprecise class and cost distributions. Proceedings of the Third International Conference on Knowledge Discovery and Data Mining (KDD-97). AAAI Press (1997) 43-48
15. Quinlan, J. R.: C4.5 Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA (1993)
16. Witten, I. H., Frank, E.: Data mining-practical machine learning tools and techniques with Java implementation. Morgan Kaufmann, San Mateo, CA (2000)
17. Zadrozny, B., Elkan, C.: Obtaining calibrated probability estimates from decision trees and Naive Bayesian classifiers. Proceedings of the 18th International Conference on Machine Learning. Morgan Kaufmann (2001) 609-616