On machine learning, ROC analysis, and statistical tests of significance

Proceedings - International Conference on Pattern Recognition

Volumn 16, Issue 2, 2002, Pages 204-207

  Maloof, Marcus A ^a  

^a GEORGETOWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; DECISION MAKING; MONTE CARLO METHODS; PATTERN RECOGNITION; PROBLEM SOLVING; STATISTICAL METHODS; ANALYSIS OF VARIANCE (ANOVA); ARTIFICIAL INTELLIGENCE; INTELLIGENT SYSTEMS; LEARNING SYSTEMS; POPULATION STATISTICS;

GAUSSIAN DISTRIBUTIONS; JACKKNIFE METHOD;

LEARNING SYSTEMS; LEARNING ALGORITHMS;

EVALUATION METHODOLOGIES; JACK-KNIFE METHOD; MEDICAL DECISION MAKING; ON-MACHINES; ROC ANALYSIS; SAMPLE VARIANCE; STATISTICAL SIGNIFICANCE;

EID: 33751566114     PISSN: 10514651     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. S. Beiden, M. Maloof, and R. Wagner. Analysis of competing classifiers in terms of components of variance of ROC summary accuracy measures. In Proceedings of the SPIE International Symposium on Medical Imaging: Image Processing, volume 4684, 2002.
2. S. Beiden, M. Maloof, and R. Wagner. Analysis of competing classifiers in terms of components of variance of ROC summary accuracy measures. IEEE Transactions on Pattern Analysis and Machine Intelligence, under review.
3. S. Beiden, R. Wagner, and G. Campbell. Components-of-variance models and multiple-bootstrap experiments: An alternative method for random-effects ROC analysis. Academic Radiology, 7:341-349, 2000.
4. A. Bradley. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition, 30(7): 1145-1159, 1997.
5. D. Dorfman, K. Berbaum, and C. Metz. Receiver Operating Characteristic rating analysis: Generalization to the population of readers and patients with the Jackknife method. Investigative Radiology, 27:723-731, 1992.
6. K. Fukunaga. Introduction to statistical pattern recognition. Academic Press, Boston, MA, 1990.
7. D. Hinkley. Jackknife methods. In S. Kotz, N. Johnson, and C. Read, editors, Encyclopedia of statistical sciences, volume 4, pages 280-287. John Wiley & Sons, New York, NY, 1983.
8. M. Maloof, P. Langley, T. Binford, and R. Nevatia. Generalizing over aspect and location for rooftop detection. In Proceedings of the Fourth IEEE Workshop on Applications of Computer Vision, pages 194-199, IEEE Press, Los Alamitos, CA, 1998.
9. M. Maloof, P. Langley, T. Binford, R. Nevatia, and S. Sage. Improved rooftop detection in aerial images with machine learning. Machine Learning, to appear.
10. C. Metz. Some practical issues of experimental design and data analysis in radiological ROC studies. Investigative Radiology, 24:234-245, 1989.
11. F. Provost, T. Fawcett, and R. Kohavi. The case against accuracy estimation for comparing induction algorithms. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 445-453, Morgan Kaufmann, San Francisco, CA, 1998.
12. J. Quinlan. C4.5: Programs for machine learning. Morgan Kaufmann, San Francisco, CA, 1993.
13. C. Roe and C. Metz. Dorfman-Berbaum-Metz method for statistical analysis of multireader, multimodality receiver operating characteristic data: Validation with computer simulation. Academic Radiology, 4:298-303, 1997.
14. H. Rowley, S. Baluja, and T. Kanade. Neural network-based face detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 203-208, IEEE Press, Los Alamitos, CA, 1996.
15. H. Sahai and M. Ageel. The analysis of variance: Fixed, random, and mixed models. Birkhäuser, Boston, MA, 2000.
16. J. Swets and R. Pickett. Evaluation of diagnostic systems: Methods from signal detection theory. Academic Press, New York, NY, 1982.
17. M. Thompson and W. Zucchini. On the statistical analysis of ROC curves. Statistics in Medicine, 18:452-462, 1986.
18. K. Woods and K. Bowyer. Generating ROC curves for artificial neural networks. IEEE Transactions on Medical Imaging. 16(3):329-337, 1997.