Analysis of proposed three-class classification decision rules in terms of the ideal observer decision rule

Journal of Mathematical Psychology

Volumn 50, Issue 5, 2006, Pages 478-487

  Edwards, Darrin C ^a   Metz, Charles E ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Ideal observer decision rules; ROC analysis; Three class classification

Indexed keywords

EID: 33745127667     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2006.05.004     Document Type: Article

References (31)

1. Bick U., Giger M.L., Schmidt R.A., Nishikawa R.M., Wolverton D.E., and Doi K. Automated segmentation of digitized mammograms. Academic Radiology 2 (1995) 1-9
2. Bunch P.C., Hamilton J.F., Sanderson G.K., and Simmons A.H. A free response approach to the measurement and characterization of radiographic-observer performance. Journal of Applied Photographic Engineering 4 (1978) 166-172
3. Chakraborty D.P. Maximum likelihood analysis of free-response operating characteristic (FROC) data. Medical Physics 16 (1989) 561-568
4. Chakraborty D.P. Statistical power in observer-performance studies: Comparison of the receiver operating characteristic and free-response methods in tasks involving localization. Academic Radiology 9 (2002) 147-156
5. Chan, H.-P., Sahiner, B., Hadjiiski, L. M., Petrick, N., & Zhou, C. (2003). Design of three-class classifiers in computer-aided diagnosis: Monte carlo simulation study. In M. Sonka, J.M. Fitzpatrick (Eds.), Proceedings of the SPIE, medical imaging 2003: Image processing (Vol. 5032, pp. 567-578). Bellingham, WA: SPIE.
6. Dreiseitl S., Ohno-Machado L., and Binder M. Comparing three-class diagnostic tests by three-way ROC analysis. Medical Decision Making 20 (2000) 323-331
7. Edwards D.C., Lan L., Metz C.E., Giger M.L., and Nishikawa R.M. Estimating three-class ideal observer decision variables for computerized detection and classification of mammographic mass lesions. Medical Physics 31 (2004) 81-90
8. Edwards D.C., Metz C.E., and Kupinski M.A. Ideal observers and optimal ROC hypersurfaces in N-class classification. IEEE Transactions on Medical Imaging 23 (2004) 891-895
9. Edwards D.C., Metz C.E., and Nishikawa R.M. The hypervolume under the ROC hypersurface of 'near-guessing' and 'near-perfect' observers in N-class classification tasks. IEEE Transactions on Medical Imaging 24 (2005) 293-299
10. Ferri, C., Hernández-Orallo, J., & Salido, M. A. (2003). Volume under the ROC surface for multi-class problems: Exact computation and evaluation of approximations. Technical Report, Dep. Sistemes Informàtics i Computació, Univ. Politècnica de València (Spain).
11. Hand D.J., and Till R.J. A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning 45 (2001) 171-186
12. He X., Metz C.E., Tsui B.M.W., Links J.M., and Frey E.C. Three-class ROC analysis-A decision theoretic approach under the ideal observer framework. IEEE Transactions on Medical Imaging 25 (2006) 571-581
13. Huo Z., Giger M.L., and Metz C.E. Effect of dominant features on neural network performance in the classification of mammographic lesions. Physics in Medicine and Biology 44 (1999) 2579-2595
14. Huo Z., Giger M.L., and Vyborny C.J. Computerized analysis of multiple-mammographic views: Potential usefulness of special view mammograms in computer-aided diagnosis. IEEE Transactions on Medical Imaging 20 (2001) 1285-1292
15. Huo Z., Giger M.L., Vyborny C.J., and Metz C.E. Breast cancer: Effectiveness of computer-aided diagnosis-Observer study with independent database of mammograms. Radiology 224 (2002) 560-568
16. Huo Z., Giger M.L., Vyborny C.J., Wolverton D.E., and Metz C.E. Computerized classification of benign and malignant masses on digitized mammograms: A study of robustness. Academic Radiology 7 (2000) 1077-1084
17. Huo Z., Giger M.L., Vyborny C.J., Wolverton D.E., Schmidt R.A., and Doi K. Automated computerized classification of malignant and benign masses on digitized mammograms. Academic Radiology 5 (1998) 155-168
18. Kupinski, M. A. (2000). Computerized pattern classification in medical imaging. Ph.D. Thesis, The University of Chicago, Chicago, IL.
19. Kupinski M.A., Edwards D.C., Giger M.L., and Metz C.E. Ideal observer approximation using Bayesian classification neural networks. IEEE Transactions on Medical Imaging 20 (2001) 886-899
20. Lachiche N., and Flach P. Improving accuracy and cost of two-class and multi-class probabilistic classifiers using ROC curves. Proceedings of the twentieth international conference on machine learning (ICML-2003) (2003), AAAI Press, Washington, DC 416-423
21. Mossman D. Three-way ROCs. Medical Decision Making 19 (1999) 78-89
22. Nakas C.T., and Yiannoutsos C.T. Ordered multiple-class ROC analysis with continuous measurements. Statistics in Medicine 23 (2004) 3437-3449
23. Obuchowski N.A., Applegate K.E., Goske M.J., Arheart K.L., Myers M.T., and Morrison S. The 'differential diagnosis' for multiple diseases: Comparison with the binary-truth state experiment in two empirical studies. Academic Radiology 8 (2001) 947-954
24. Patel, A. C., Markey, M. K. (2005). Comparison of three-class classification performance metrics: A case study in breast cancer CAD. In M.P. Eckstein, Y. Jiang (Eds.), Proceedings of the SPIE, medical imaging 2005: Image perception, observer performance, and technology assessment (Vol. 5749, pp. 581-589). Bellingham, WA, SPIE.
25. Scurfield B.K. Multiple-event forced-choice tasks in the theory of signal detectability. Journal of Mathematical Psychology 40 (1996) 253-269
26. Scurfield B.K. Generalization of the theory of signal detectability to n-event m-dimensional forced-choice tasks. Journal of Mathematical Psychology 42 (1998) 5-31
27. Srinivasan, A. (1999). Note on the location of optimal classifiers in n-dimensional ROC space. Technical Report PRG-TR-2-99, Oxford University Computing Laboratory, Wolfson Building, Parks Road, Oxford.
28. Van Trees H.L. Detection, estimation and modulation theory: Part I (1968), Wiley, New York
29. Yin F.-F., Giger M.L., Doi K., Metz C.E., Vyborny C.J., and Schmidt R.A. Computerized detection of masses in digital mammograms: Analysis of bilateral subtraction images. Medical Physics 18 (1991) 955-963
30. Yin F.-F., Giger M.L., Doi K., Vyborny C.J., and Schmidt R.A. Computerized detection of masses in digital mammograms: Automated alignment of breast images and its effect on bilateral-subtraction technique. Medical Physics 21 (1994) 445-452
31. Yin F.-F., Giger M.L., Vyborny C.J., Doi K., and Schmidt R.A. Comparison of bilateral-subtraction and single-image processing techniques in the computerized detection of mammographic masses. Investigation Radiology 28 (1993) 473-481