Evaluating classifiers: Relation between area under the receiver operator characteristic curve and overall accuracy

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 2045-2049

  Mazurowski, Maciej A ^a   Tourassi, Georgia D ^a,b  

^a DUKE UNIVERSITY   (United States)

^b University of Louisville   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASS IMBALANCE; CLASSIFIER PERFORMANCE; CONTROLLED CONDITIONS; DETRIMENTAL EFFECTS; MULTIPLE NEURAL NETWORKS; PERFORMANCE MEASURE; RECEIVER OPERATOR CHARACTERISTIC CURVES; TEST SETS;

CLASSIFIERS; LEARNING SYSTEMS;

NEURAL NETWORKS;

EID: 70449421914     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178752     Document Type: Conference Paper

References (18)

1. J. M. Zurada, Introduction to Artificial Neural Systems. West Publishing Company, 1992.
2. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Wiley- Interscience, 2000.
3. C. Cortes and V. Vapnik, "Support-vector networks, " Machine Learning, vol. 20, pp. 273-297, 1995.
4. T. Mitchell, Machine Learning. McGraw Hill, 1997.
5. A. P. Bradley, "The use of the area uncer the roc curve in the evaluation of machine learning algorithms, " Pattern Recognition, vol. 30, pp. 1145-1159, 1997.
6. T. Fawcett, "An introduction to roc analysis, " Pattern Recognition Letters, vol. 27, pp. 861-874, 2006.
7. R. F. Wagner, C. E. Metz, and G. Campbell, "Assessment of medical imaging systems and computer aids: A tutorial review, " Academic Radiology, vol. 14, p. 723748, 2007.
8. H. Luan, F. Qi, Z. Xue, L. Chen, and D. Shen, "Multimodality image registration by maximization of quantitativequalitative measure of mutual information, " Pattern Recognition, vol. 41, pp. 285-298, 2008.
9. S. J. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, pp. 252-264, 1991.
10. S. Raudys, "On dimensionality, sample size, and classification error of nonparametric linear classification algorithms, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, pp. 667-671, 1997.
11. H. P. Chan, B. Sahiner, R. F. Wagner, and N. Petrick, "Classifier design for computer-aided diagnosis: effects of finite sample size on the mean performance of classical and neural network classifiers, " Med Phys, vol. 26, no. 12, pp. 2654-2668, Dec. 1999.
12. S. V. Beiden, M. A. Maloof, and R. F. Wagner, "A general model for finite-sample effects in training and testing of competing classifiers, " IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 23, pp. 1561-1569, 2003.
13. B. Sahiner, H.-P. Chan, and L. Hadjiiski, "Classifier performance prediction for computer-aided diagnosis using a limited dataset." Med Phys, vol. 35, no. 4, pp. 1559-1570, Apr. 2008.
14. Q. Li and K. Doi, "Comparison of typical evaluation methods for computer-aided diagnostic schemes: Monte carlo simulation study." Medical Physics, vol. 34, no. 3, pp. 871-876, Mar. 2007.
15. F. J. Provost, T. Fawcett, and R. Kohavi, "The case against accuracy estimation for comparing induction algorithms, " in Proceedings of the Fifteenth International Conference on Machine Learning, 1998, pp. 445-453.
16. P. A. Habas, J. M. Zurada, A. S. Elmaghraby, and G. D. Tourassi, "Particle swarm optimization of neural network cad systems with clinically relevant objectives, " in Medical Imaging 2007: Computer- Aided Diagnosis, Proc. SPIE, vol. 6514, 2007.
17. M. A. Mazurowski, J. M. Zurada, and G. D. Tourassi, "Selection of examples in case-based computer-aided decision systems, " Physics in Medicine and Biology, vol. 53, pp. 6079-6096, 2008.
18. M. A. Mazurowski, P. A. Habas, J. M. Zurada, J. Y. Lo, J. A. Baker, and G. D. Tourassi, "Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance, " Neural Networks, vol. 21, pp. 427-436, 2008.