Data mining in metric space: An empirical analysis of supervised learning performance criteria

KDD-2004 - Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2004, Pages 69-78

  Caruana, Rich ^a   Niculescu Mizil, Alexandru ^a  

^a Department of Obstetrics Gynecology   (United States)

Author keywords

Cross Entropy; Lift; Metrics; Performance Evaluation; Precision; Recall; ROC; Supervised Learning

Indexed keywords

CROSS ENTROPY; METRICS; MULTIDIMENSIONL SCALING (MDS); PERFORMANCE EVALUATION; PRECISION; RECALL; ROC; SUPERVISED LEARNING;

ALGORITHMS; DATA ACQUISITION; ENTROPY; ERROR ANALYSIS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MEASUREMENTS; PERFORMANCE; PROBABILITY;

DATA MINING;

EID: 12244279570     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. C. Blake and C. Merz. UCI repository of machine learning databases, 1998.
2. M. DeGroot and S. Fienberg. The comparison and evaluation of forecasters. Statistician, 32(1):12-22, 1982.
3. P. Giudici. Applied Data Mining. John Wiley and Sons, New York, 2003.
4. A. Gualtieri, S. R. Chettri, R. Cromp, and L. Johnson. Support vector machine classifiers as applied to aviris data. In Proc. Eighth JPL Airborne Geoscience Workshop, 1999.
5. T. Joachims. Making large-scale svm learning practical. In Advances in Kernel Methods, 1999.
6. R. King, C. Feng, and A. Shutherland. Statlog: comparison of classification algorithms on large real-world problems. Applied Artificial Intelligence, 9(3):259-287, May/June 1995.
7. P.A.Flach. The geometry of roc space: understanding machine learning metrics through roc isometrics. In Proc. 20th International Conference on Machine Learning (ICML'03), pages 194-201. AAAI Press, January 2003.
8. J. Platt. Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In A. Smola, P. Bartlett, B. Schoelkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers, pages 61-74, 1999.
9. F. Provost and P. Domingos. Tree induction for probability-based rankings. Machine Learning, 52(3), 2003.
10. F. J. Provost and T. Fawcett. Analysis and visualization of classifier performance: Comparison under imprecise class and cost distributions. In Knowledge Discovery and Data Mining, pages 43-48, 1997.