Cost-sensitive classifier evaluation

Proceedings of the 1st International Workshop on Utility-Based Data Mining, UBDM '05

Volumn , Issue , 2005, Pages 3-9

  Holte, Robert C ^a   Drummond, Chris ^b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b NATIONAL RESEARCH COUNCIL CANADA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS DISTRIBUTIONS; CLASSIC TECHNIQUES; CLASSIFIER EVALUATION; CLASSIFIER PERFORMANCE; COST CURVES; COST-SENSITIVE; MISCLASSIFICATION COSTS; OPERATING CONDITION; ROC CURVES;

CLASSIFIERS; COSTS; DATA MINING; VISUALIZATION;

COST BENEFIT ANALYSIS;

EID: 77953566276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1089827.1089843     Document Type: Conference Paper

References (16)

1. C. L. Blake and C. J. Merz. UCI repository of machine learning databases, University of California, Irvine, CA www.ics.uciedu/~mlearn/MLRepository.html, 1998.
2. Chris Drummond and Robert C. Holte. Explicitly representing expected cost: An alternative to roc representation. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 198-207, 2000.
3. Chris Drummond and Robert C. Holte. Exploiting the cost (in)sensitivity of decision tree splitting criteria. In Proceedings of the Seventeenth International Conference on Machine Learning, pages 239-246, 2000.
4. Chris Drummond and Robert C. Holte. What ROC Curves can't do (and Cost Curves can). In Proceedings of the 1st Workshop on ROC Analysis in Artificial Intelligence (held in conjunction with ECAI 2004), pages 19-26, 2004.
5. R. O. Duda and P. E. Hart. Pattern Classification and scene analysis. Wiley, New York, 1973.
6. B. Efron and R. Tibshirani. An Introduction to the Bootstrap. Chapman and Hall, London, 1993.
7. Robert C. Holte. Very simple classification rules perform well on most commonly used datasets. Machine Learning, 11(1):63-91, 1993.
8. Dragos D. Margineantu and Thomas G. Dietterich. Bootstrap methods for the costsensitive evaluation of classifiers. In Proceedings of the Seventeenth International Conference on Machine Learning, pages 82-590, 2000.
9. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk. Reducing misclassification costs. In Proceedings of the Eleventh International Conference on Machine Learning, pages 217-225, San Francisco, 1994. Morgan Kaufmann.
10. Foster Provost and Tom Fawcett. Robust classification systems for imprecise environments. In Proceedings of the Fifteenth National Conference on Artificial Intelligence, pages 706-713, Menlo Park, CA, 1998. AAAI Press.
11. Foster Provost, Tom Fawcett, and Ron Kohavi. The case against accuracy estimation for comparing induction algorithms. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 3-48, San Francisco, 1998. Morgan Kaufmann.
12. J. Ross Quinlan. C4.5 Programs for Machine Learning. Morgan Kaufmann, San Mateo, California, 1993.
13. J. A. Swets. Information Retrieval Systems. Bolt, Beranek and Newman, Cambridge Massachusetts, 1967.
14. John A. Swets and Ronald M. Pickett. Evaluation of diagnostic systems : methods from signal detection theory. Academic Press, New York, 1982.
15. C. J Van Rijsbergen. Information retrieval. Butterworths, London, 1979.
16. G. Webb and K. M. Ting. On the application of ROC analysis to predict classification performance under varying class distributions. Machine Learning, 8(1):25-32, 2005.